<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[luorisheng的专栏]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/luorisheng</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; luorisheng]]></copyright><item><title><![CDATA[文章标题]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/49303301</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/49303301</guid><author>luorisheng</author><pubDate>Wed, 21 Oct 2015 13:40:03 +0800</pubDate><description><![CDATA[deflate 文件 
hadoop fs -text file.deflate > your file directory]]></description><category></category></item><item><title><![CDATA[android 环境配置 ubuntu 14.04 64位]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/84737497</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/84737497</guid><author>luorisheng</author><pubDate>Fri, 14 Aug 2015 08:26:00 +0800</pubDate><description><![CDATA[
1.下载adt-bundle-linux-x86_64-20131030.zip
2.path环境变量设置
3.创建项目
r can't be resolved to a variable android 4.4
下载32位相关包报错
apt-get install ia32-libs
阿里云源, 改更新源sudo gedit /etc/apt/sources.list,
deb...]]></description><category></category></item><item><title><![CDATA[MapReduce类型与格式]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/11018835</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/11018835</guid><author>luorisheng</author><pubDate>Fri, 08 May 2015 13:31:38 +0800</pubDate><description><![CDATA[MapReduce类型
map:(k1,v1)->(k2,v2)
reduce(k2,list(v2))->list(k3,v3)


public interface Mapper extends JobConfigurable,Closeable{
 void map(K1 key,V1 value,OutputCollector output,Reporter reporter)]]></description><category></category></item><item><title><![CDATA[HIVE使用小计]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/45578609</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/45578609</guid><author>luorisheng</author><pubDate>Fri, 08 May 2015 13:22:19 +0800</pubDate><description><![CDATA[join 中MR顺序Hive总是按照从左到右的顺序执行表的连接，同时假定最后一个表是最大的那个表，并尝试缓存前边的表。]]></description><category></category></item><item><title><![CDATA[MR小记]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/45578161</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/45578161</guid><author>luorisheng</author><pubDate>Fri, 08 May 2015 12:28:09 +0800</pubDate><description><![CDATA[小文件问题CombineFileInputFormat子类CombineTextInputFormat，可以减少map数，但是不能本地化，因此内存资源充足的情况下，CombineFileInputFormat减少map数，不一定会增加MR性能。压缩问题采用压缩文件，需要考虑压缩后文件的大小与hdfs块大小的关系，因为有些压缩算法本身是不可分的，如果压缩后文件是多块的，会造成map不能本地化。 
压缩]]></description><category></category></item><item><title><![CDATA[PIG 使用小记]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/45396235</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/45396235</guid><author>luorisheng</author><pubDate>Thu, 30 Apr 2015 16:15:44 +0800</pubDate><description><![CDATA[pig手册三目运算符？ type1：type2  type1和2 类型一致，空用null，Unsupported input type for BinCond: left hand side: chararray; right hand side: long]]></description><category></category></item><item><title><![CDATA[sqoop 使用小计]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/44064503</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/44064503</guid><author>luorisheng</author><pubDate>Wed, 04 Mar 2015 19:51:11 +0800</pubDate><description><![CDATA[HIVE导出空值\N ,sqoop 导入数据库中时，可能\N字符串无法转换对应类型–input-null-non-string \N –input-null-string \Nsqoop导入的时候会生成queryresult.jar–class-name jarName经常遇见的split数量不对问题，combineinputformat-D   mapreduce.job.max.split.lo]]></description><category></category></item><item><title><![CDATA[eclipse 那些有用的快捷键]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/44060945</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/44060945</guid><author>luorisheng</author><pubDate>Wed, 04 Mar 2015 15:33:21 +0800</pubDate><description><![CDATA[eclipse 那些有用的快捷键shift+alt+m 抽取方法，方便，参数自动生成 
ctrl+k  find的next  无须复制 
ctrl+alt+向下方向 向下复制选中代码，不影响当前复制的内容 
ctrl+e 
ctrl+o]]></description><category></category></item><item><title><![CDATA[java调试整理]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/11389599</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/11389599</guid><author>luorisheng</author><pubDate>Sun, 08 Sep 2013 18:42:55 +0800</pubDate><description><![CDATA[常用参数显示查找
java -?
java -X  非标准参数
java -XX:+PrintFlagsFinal 非稳定参数 jdk1.6 update 21之后


jps -l主类全名 -v jvm参数
jstat 
-class 类装载耗时 -gc java堆状况
-gcutil 百分比显示
-gccause 上次gc原因
eg.:jstat -gcutil -h20]]></description><category></category></item><item><title><![CDATA[ubuntu10.10 eclipse编译hadoop1.0.X]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7706207</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7706207</guid><author>luorisheng</author><pubDate>Sun, 01 Jul 2012 10:55:25 +0800</pubDate><description><![CDATA[参照http://wiki.apache.org/hadoop/EclipseEnvironment
eclipse、git、maven下载略

$ mvn install -DskipTests
$ mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true

1、报错
***********
[INFO]]]></description><category></category></item><item><title><![CDATA[jstack:JAVA堆栈跟踪工具]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7681174</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7681174</guid><author>luorisheng</author><pubDate>Wed, 20 Jun 2012 22:18:27 +0800</pubDate><description><![CDATA[jstack命令格式
jstack | option | vmid
-F 当正常输出的请求不被响应时，强制输出线程堆栈
-l 除堆栈外，显示关于锁的附加信息
-m 如果调用到本地方法的话，可以显示c/c++的堆栈


jps 显示java进程
根据vmid  jstack vmid显示堆栈]]></description><category></category></item><item><title><![CDATA[hadoop 问题 copyFromLocal: java.io.FileNotFoundException: Parent path is not a directory: /user/admini]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7674926</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7674926</guid><author>luorisheng</author><pubDate>Mon, 18 Jun 2012 23:10:25 +0800</pubDate><description><![CDATA[----配置-----

dfs.name.dir
/home/administrator/hadoop/hdfs/name
  
  
dfs.data.dir
  /home/administrator/hadoop/hdfs/data
  
---与这个配置估计有关系,貌似是目录问题--- -
------------命令----------
hadoop fs -co]]></description><category></category></item><item><title><![CDATA[hadoop 问题]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7674919</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7674919</guid><author>luorisheng</author><pubDate>Mon, 18 Jun 2012 23:08:11 +0800</pubDate><description><![CDATA[-----------配置-------------------
hadoop -jar job.jar -conf hadoop-localhost.xml input/ tmp




fs.default.name
hdfs://localhost/
  

mapred.job.tracker
localhost:8021




-------------]]></description><category></category></item><item><title><![CDATA[默默耕耘2 hadoop]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7482919</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7482919</guid><author>luorisheng</author><pubDate>Fri, 20 Apr 2012 21:38:46 +0800</pubDate><description><![CDATA[namenode没有启动log报错
Directory /tmp/hadoop-administrator/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
ubuntu tmp目录问题
在hdfs-site.xml中添加，新建hadoop目录

dfs]]></description><category></category></item><item><title><![CDATA[默默耕耘1  hadoop]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/7479170</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/7479170</guid><author>luorisheng</author><pubDate>Thu, 19 Apr 2012 21:43:24 +0800</pubDate><description><![CDATA[hadoop in action 
ubuntu 下ssh localhost connect to host localhost port 22:Connection refused
which sshd找不到 没有server
安装
sudo apt-get install openssh-server

ssh localhost 成功]]></description><category></category></item><item><title><![CDATA[参加IBM笔试了]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/83399912</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/83399912</guid><author>luorisheng</author><pubDate>Sun, 24 May 2009 22:11:46 +0800</pubDate><description><![CDATA[今天到中科院参加了IBM实习生笔试，感触很多。
 
第一，与考试无关的。参加笔试的人每个人的心情不一样，面对笔试有些人只是想尝试一下，有些人则报以很高的期望。我吗，实事求是，差距太大，最重要的就是英语太差了，做题速度太慢，着急不能稳稳的答题。面对前面的能力测试准备不够充足导致刚刚开始就把题答错了，这两点都需要自省一下。实际上本科生本来是没有机会的，能过与汤等研究生一起参加已经是莫大的荣幸了，但...]]></description><category></category></item><item><title><![CDATA[a different object with the same identifier value]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/83369856</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/83369856</guid><author>luorisheng</author><pubDate>Tue, 07 Apr 2009 21:16:34 +0800</pubDate><description><![CDATA[ 
两次遇到这个问题a different object with the same identifier value
 
第一次是要修改数据库里的记录，因为之前已经将该条记录取到了session缓存中，用update（游离态对象）方法时发生错误，一个游离态对象和一个持久态对象，具有相同OID，因此报错。
解决办法用merge（游离态对象），该方法应该是根据游离态对象的OID，执行select语句...]]></description><category></category></item><item><title><![CDATA[struts2.0首页路径问题]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/83364947</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/83364947</guid><author>luorisheng</author><pubDate>Sun, 22 Mar 2009 12:56:50 +0800</pubDate><description><![CDATA[  做开发没怎么做过页面，这几天试了试，出现了错误
我将首页设置在一个文件夹下reader了，从该页提交登录action，返回的result结果地址中，包含该文件夹的地址，例如struts.xml中是result为success.jsp，实际是转到./reader/success.jsp。但是当在success.jsp中提交注销action时，虽然struts.xml中result为index.j...]]></description><category></category></item><item><title><![CDATA[刚刚开始学习struts]]></title><link>https://blog.youkuaiyun.com/luorisheng/article/details/3001579</link><guid>https://blog.youkuaiyun.com/luorisheng/article/details/3001579</guid><author>luorisheng</author><pubDate>Tue, 30 Sep 2008 10:26:00 +0800</pubDate><description><![CDATA[这两天在学习struts，发现这东西确实是很好，但是有点感觉越来越像。NET的自动化。可能是学的还不过深入。努力呀！！！！！！！嘎嘎]]></description><category></category></item></channel></rss>