<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[conglu3007的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/conglu3007</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; conglu3007]]></copyright><item><title><![CDATA[mahout0.6版本中，启动出现找不到PrepareTwentyNewsgroups的解决办法]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311367</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311367</guid><author>conglu3007</author><pubDate>Sun, 31 Aug 2014 15:04:45 +0800</pubDate><description><![CDATA[安装完mahout后，会出现java.lang.ClassNotFoundException: org.apache.mahout.classifier.bayes.PrepareTwentyNewsgroups这个错，...]]></description><category></category></item><item><title><![CDATA[在Hadoop中，引入第三方JAR包时，报ClassNotFoundException问题的解决办法]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311377</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311377</guid><author>conglu3007</author><pubDate>Sun, 24 Aug 2014 14:34:07 +0800</pubDate><description><![CDATA[本人在Windows下用Eclipse开发Hadoop程序，用常规的方法，把第三方的JAR包用Config Build Path的方法引入JAR包，但是运行报错，


	后来我把JAR包放到hadoop/lib目录，...]]></description><category></category></item><item><title><![CDATA[关于在IE8下禁用兼容模式的方法]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311364</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311364</guid><author>conglu3007</author><pubDate>Tue, 05 Aug 2014 17:23:09 +0800</pubDate><description><![CDATA[参见:
http://www.iefans.net/ie-jianrong-moshi-mogui-tianshi/
                                                      ...]]></description><category></category></item><item><title><![CDATA[datafu-1.0.0.jar下载]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311376</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311376</guid><author>conglu3007</author><pubDate>Sun, 03 Aug 2014 15:33:10 +0800</pubDate><description><![CDATA[https://www.versioneye.com/java/com.linkedin.datafu:datafu/1.0.0
                                                 ...]]></description><category></category></item><item><title><![CDATA[pig各版本下载]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311374</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311374</guid><author>conglu3007</author><pubDate>Sun, 03 Aug 2014 15:17:32 +0800</pubDate><description><![CDATA[http://mirrors.hust.edu.cn/apache/pig/
                                                            
              ...]]></description><category></category></item><item><title><![CDATA[mahout各版本下载]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311375</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311375</guid><author>conglu3007</author><pubDate>Tue, 29 Jul 2014 16:46:03 +0800</pubDate><description><![CDATA[http://archive.apache.org/dist/mahout/0.6/
                                                            
          ...]]></description><category></category></item><item><title><![CDATA[shell小工具查看Hadoop中System.out输出的日志]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311362</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311362</guid><author>conglu3007</author><pubDate>Sun, 13 Jul 2014 22:56:29 +0800</pubDate><description><![CDATA[#!/bin/bash
rm ~/log.log
echo "Please Input JobID:"
read NAME
map_log="/home/grid/hadoop-1.2.1/logs/userlogs/$...]]></description><category></category></item><item><title><![CDATA[Linux Shell脚本截取字符串]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311368</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311368</guid><author>conglu3007</author><pubDate>Sun, 13 Jul 2014 22:28:15 +0800</pubDate><description><![CDATA[http://blog.youkuaiyun.com/gumanren/article/details/5601544
                                                            ...]]></description><category></category></item><item><title><![CDATA[在VI下进行搜索]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311361</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311361</guid><author>conglu3007</author><pubDate>Wed, 02 Jul 2014 23:31:34 +0800</pubDate><description><![CDATA[你在命令模式下敲斜杆(/)这时在状态栏（也就是屏幕左下脚）就出现了 “/”然后输入你要查找的关键字
如果你要继续查找此关键字，敲字符n就可以继续查找了。
                                    ...]]></description><category></category></item><item><title><![CDATA[个人对shuffle的理解]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311370</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311370</guid><author>conglu3007</author><pubDate>Sun, 29 Jun 2014 22:58:58 +0800</pubDate><description><![CDATA[1）mapping的过程就是把原始数据读成key，value对的形式
2）reducer的过程就是把mapping的键值对计算成为我们最终我们想要的数据
3）shuffle的定义是：把key相同的行聚合到一起，形成一个{ke...]]></description><category></category></item><item><title><![CDATA[关于运行Hadoop是报：Type mismatch in key from map]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311371</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311371</guid><author>conglu3007</author><pubDate>Sun, 29 Jun 2014 09:30:14 +0800</pubDate><description><![CDATA[找了好久MaxTemperatureMapper的22行，好像也没有问题，结果在MaxTemperature.java中没有指定：job.setOutputValueClass(IntWritable.class);因为默认...]]></description><category></category></item><item><title><![CDATA[以JAR包的形式运行Hadoop程序]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311359</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311359</guid><author>conglu3007</author><pubDate>Sun, 29 Jun 2014 08:46:02 +0800</pubDate><description><![CDATA[1.先用带classpath的形式编译所有的java文件：javac -classpath ../hadoop-core-1.2.1.jar *.java

2.把所有的class文件打成jar包：jar cvf MaxTe...]]></description><category></category></item><item><title><![CDATA[Hadoop下添加节点和删除节点]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311363</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311363</guid><author>conglu3007</author><pubDate>Sat, 28 Jun 2014 23:21:41 +0800</pubDate><description><![CDATA[http://www.dataguru.cn/forum.php?mod=viewthread&amp;tid=175348
                                                   ...]]></description><category></category></item><item><title><![CDATA[hadoop 1.2.1的API地址]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311366</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311366</guid><author>conglu3007</author><pubDate>Sun, 22 Jun 2014 22:16:41 +0800</pubDate><description><![CDATA[http://hadoop.apache.org/docs/r1.2.1/api/index.html
                                                            
 ...]]></description><category></category></item><item><title><![CDATA[在Hadoop1.2.1上运行第一个Hadoop程序FileSystemCat]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311127</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311127</guid><author>conglu3007</author><pubDate>Sun, 22 Jun 2014 21:52:05 +0800</pubDate><description><![CDATA[1.设置hadoop-env.sh的exportHADOOP_CLASSPATH=/home/grid/hadoop-1.2.1/myclass 


	2.设置JAVA_HOME和ClassPath 

...]]></description><category></category></item><item><title><![CDATA[hadoop各版本下载地址]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311130</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311130</guid><author>conglu3007</author><pubDate>Sat, 14 Jun 2014 15:56:31 +0800</pubDate><description><![CDATA[http://mirror.bit.edu.cn/apache/hadoop/common/
                                                            
      ...]]></description><category></category></item><item><title><![CDATA[Hadoop常用命令]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311125</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311125</guid><author>conglu3007</author><pubDate>Sat, 14 Jun 2014 14:32:32 +0800</pubDate><description><![CDATA[1.向Hadoop中复制文件,一定要是目录对目录：bin/hadoop fs -put ../input in

2.查看Hadoop的文件：bin/hadoop fs -ls ./in

3.启动集群：bin/star...]]></description><category></category></item><item><title><![CDATA[hadoop在子节点上没有datanode进程]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311353</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311353</guid><author>conglu3007</author><pubDate>Sat, 14 Jun 2014 13:30:52 +0800</pubDate><description><![CDATA[经常会有这样的事情发生：在主节点上start-all.sh后，子节点有TaskTracker进程，而没有DataNode进程。
环境：1NameNode 2DataNode三台机器，Hadoop为1.2.1
解决办法：...]]></description><category></category></item><item><title><![CDATA[Linux下出现command not found的解决办法]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311124</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311124</guid><author>conglu3007</author><pubDate>Sun, 08 Jun 2014 09:18:32 +0800</pubDate><description><![CDATA[不管是普通用户还是ROOT用户，修改~/.bash_profile文件，在文件最后加上：
export PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr...]]></description><category></category></item><item><title><![CDATA[配置Hadoop1.2.1]]></title><link>https://blog.youkuaiyun.com/conglu3007/article/details/100311123</link><guid>https://blog.youkuaiyun.com/conglu3007/article/details/100311123</guid><author>conglu3007</author><pubDate>Sat, 07 Jun 2014 23:19:24 +0800</pubDate><description><![CDATA[1.从Apache官网上下载1.2.1，地址：http://apache.dataguru.cn/hadoop/common/hadoop-1.2.1/hadoop-1.2.1-bin.tar.gz
2.拷贝文件到虚拟机下（v...]]></description><category></category></item></channel></rss>