Hue: common errors solution 1

本文解决Hue界面中出现的各种问题,包括作业浏览器中日志图标不显示、文件浏览器错误、工作流点击错误等,并提供详细的Hadoop配置调整方案。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

1. when click a job in 'Job Browser' panle,  the log of the job doesn't appare



 R: Hadoop2.x has the ablity to aggregate logs from cluster nodes and purge the old logs. My problem is rooted at wrong vm guest clock(namenode runs on my local host while the other three datanodes run on

 centos6.4 vms ). I save all VMs when log out, and exit the local host system. Next time,  the VM  guests have wrong time when resumed to live.

 A: option 1:  synchronize the time in guests

date && hwclock --hctosys && date

     option 2: change hadoop configurations  (mapred-site.xml)

                    mapreduce.jobhistory.max-age-ms

                    mapreduce.jobhistory.cleaner.interval-ms

 

2.When check a file in hdfs through 'File Browser',there is a error



 

when I first login Hue UI, I used 'hue' as the username althrough I added 'zhaohj' as a superuser and logined with this name. Hue still use 'hue' to as its identity. Meanwhile, the core-site.xml of hadoop is :



The root cause is wrong configurations.

A: the correct configuration fragements likes . The 'zhaohj' is the name who login hue server.

--core-site.xml

<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>zhaohj</value>
</property>
--hdfs-site.xml

<property>
  <name>dfs.webhdfs.enabled</name>
  <value>true</value>
</property>

<property>
   <name>dfs.permissions.enabled</name>
   <value>true</value>
</property>

<property>
   <name>dfs.web.ugi</name>
   <value>zhaohj</value>
</property>
--httpfs-site.xml

<property>
  <name>httpfs.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>httpfs.proxyuser.hue.groups</name>
  <value>zhaohj</value>
</property>

 

3. The oozie is running, when I click WorkFlows, there appares a error

An error occurred with Oozie.

User [hue] not defined as proxyuser

A:Hue submits MapReduce jobs to Oozie as the logged in user. You need to configure Oozie to accept the hue user to be a proxyuser. Specify this in your oozie-site.xml (even in a non-secure cluster), and restart Oozie:

<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.hosts</name>
    <value>*</value>
</property>
<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.groups</name>
    <value>*</value>
</property>

http://archive.cloudera.com/cdh4/cdh/4/hue-2.0.0-cdh4.0.1/manual.html

 

4. When I submit a sqoop job from "Job Designer", produce errors:



 

I check the sqoop comands and comfired that all are correct. At last, I found that there have to one just only one space between two parametes.

eg.

--table       user     //will lead to syntax error 
--table user          //yes

 

 5.when submit a sqoop job (using mysql to store hive metastore and hue/oozie data )

 

 A: to restart mysql is adopted.

 

 

 

 

 

 

 

 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值