Hive端执行 select count(*) from cdprojectdetail；出现如下错误：

原创

已于 2022-04-21 17:48:18 修改 · 2.9k 阅读

8 ·

CC 4.0 BY-SA版权

文章标签：

#hive #hbase

于 2022-04-21 17:47:56 首次发布

在Hive中执行`select count(*) from cdprojectdetail`时遇到错误，经过排查发现是由于Namenode内存不足导致的新job无法运行。通过在Hive shell中设置`hive.exec.mode.local.auto=true`使得任务在本地模式下执行，问题得到解决。

好不容易搞出了hbase和hive的外链表组合应用。却在 hive端执行 select count(*) from cdprojectdetail; 出现如下错误：

Query ID = root_20220421173314_ade31c99-1ec5-4419-88c7-997bf8e82577
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
2022-04-21 17:33:15 INFO client.AHSProxy: Connecting to Application History server at udp02/10.12.3.12:10201
2022-04-21 17:33:15 INFO client.AHSProxy: Connecting to Application History server at udp02/10.12.3.12:10201
Starting Job = job_1649670158454_0012, Tracking URL = http://udp01:8088/proxy/application_1649670158454_0012/
Kill Command = /opt/usdp-srv/srv/ud