hive 虚拟机下执行 HQL 被killed退出

最新推荐文章于 2021-12-28 15:50:51 发布

多多-江北残刀

最新推荐文章于 2021-12-28 15:50:51 发布

阅读量3.9k

点赞数 3

CC 4.0 BY-SA版权

分类专栏： hadoop hive 文章标签： hive hadoop 大数据 virtual box

本文链接：https://blog.youkuaiyun.com/beijihukk/article/details/58588551

在学习大数据过程中，使用装有CentOS7的虚拟机（内存512MB）运行Hive时，HQL查询被killed且无明显错误信息。通过增大虚拟机内存至1GB解决问题，表明内存不足可能是导致Hive异常退出的原因。当遇到类似情况且日志无误时，可检查虚拟机内存配置。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

背景：学习大数据，装了个虚拟机，搭载centos7的迷你，内存分配的512MB

hive> select A.name,A.time
> from
> (select name,time,sum(count) from sale group by name, time) A join
> (select name,time,sum(count) from sale group by name, time) B
> on A.name=B.name
> where A.time >= B.time
> group by A.name,A.time
> order by A.name,A.time;
WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = root_20170227013835_5b837518-4c01-4dd5-8097-99d9dfdd39d7
Total jobs = 7
Launching Job 1 out of 7
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>