tucailing的专栏

org.apache.oozie.servlet.XServletException: E0902: Exception occured: [org.apache.hadoop.ipc.RemoteException: User: root is not allowed to impersonate root] at org.apache.oozie.servlet.BaseJobServle

在win7用Ant编译hadoop工程的时候，遇到了一个报错，如下： 　　org.eclipse.core.runtime.CoreException: D:\workspace\hadoop-1.1.2\build.xml:83: Execute failed: java.io.IOException: Cannot run program "sed" 　　打开build.xml文件，找到s

hadoop.security.AccessControlRxception:Pression denied user=xxx access=READ_EXECUTE,inode=".staging" inode="user":hadoop:supergroup:rwxr-xr-x sulution：added this entry to conf/hdfs-site.xml df

Cannot connect to the Map/Reduce location: hadoop java.io.IOException: Unknown protocol to name node: org.apache.hadoop.mapred.JobSubmissionProtocol at org.apache.hadoop.hdfs.server.namenode.NameNod

记录一下，解决方法是：mapreduce的jobtracker和namenode端口配置错误了

2013-07-04 01:21:50,677 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Not able to place enough replicas, still in need of 1 2013-07-04 01:21:50,677 ERROR org.apache.hadoop.security.UserGr

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /dfs/dfs/data: namenode namespaceID = 698802253; datanode namespaceID = 817847838 at org.apach

一、下载pig 在http://mirrors.cnnic.cn/apache/pig/上下载 pig-0.9.2.tar.gz，我的是下载到/usr/local/目录 二、解压安装pig 打开进入到local目录下，执行 # tar -zxvf pig-0.9.2.tar.gz 解压到pig-0.9.2目录下 三、配置环境变量 # vi /etc/profil

忘记这个错误什么时候出现的了，大概是一下两种情况会出现： 1、启动eclipse的时候，DFS报错 2、运行Map/Reduce程序的时候 Cannot connect to the Map/Reduce location: hadoop2 Call to localhost/127.0.0.1:9001 failed on connection exception: java.net

启动hadoop的时候，DataNode启动不起来，看看log才发现有问题： 2013-06-25 00:22:03,962 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:  /************************************************************ STAR

输入[root@localhost bin]# hadoop fs -ls  / 报bash: hadoop: command not found 这个错误 需要将hadoop/bin路径加入PATH，配置环境变量 [root@localhost bin]# vi ~/.bash_profile 打开文件，添加hadoop的bin路径到path中 PATH=$PATH:$HOME/bin

目标：ssh localhost 无需键入密码 步骤 ： 前提：确认主机安装ssh  shhd  分别是 ssh客户端和server端 使用hadoop账户 方法一： ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys [r