从零教你如何获取hadoop2.4源码并使用eclipse关联hadoop2.4源码

我们如果想搞开发，研究源码对我们的帮助很大。不明白原理就如同黑盒子，遇到问题，我们也摸不着思路。所以这里交给大家
一.如何获取源码
二.如何关联源码

一.如何获取源码

1.下载hadoop的maven程序包

（1）官网下载
这里我们先从官网上下载maven包hadoop-2.4.0-src.tar.gz。
官网下载地址


（2）网盘下载
也可以从网盘下载：
http://pan.baidu.com/s/1kToPuGB

2.通过maven获取源码
获取源码的方式有两种，一种是通过命令行的方式，一种是通过 eclipse 。这里主要讲通过命令的方式

通过命令的方式获取源码：
1.解压包

 


解压包的时候遇到了下面问题。不过不用管，我们继续往下走

1        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn- server\hadoop-yarn-server-applicationhistoryservice\target\classes\org\apache\hadoop\yarn\server\applicationhistoryservice\ApplicationHistoryClientService$ApplicationHSClientProtocolHandler.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
2        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn- server\hadoop-yarn-server-applicationhistoryservice\target\classes\org\apache\hadoop\yarn\server\applicationhistoryservice\timeline\LeveldbTimelineStore$LockMap$CountingReentrantLock.class：系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
3        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-server\hadoop-yarn-server-applicationhistoryservice\target\test-classes\org\apache\hadoop\yarn\server\applicationhistoryservice\webapp\TestAHSWebApp$MockApplicationHistoryManagerImpl.class：系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
4        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn- server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\server\resourcemanager\monitor\capacity\TestProportionalCapacityPreemptionPolicy$IsPreemptionRequestFor.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
5        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn-server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\server\resourcemanager\recovery\TestFSRMStateStore$TestFSRMStateStoreTester$TestFileSystemRMStore.class：系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
6        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn-project\hadoop-yarn\hadoop-yarn- server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\server\resourcemanager\recovery\TestZKRMStateStore$TestZKRMStateStoreTester$TestZKRMStateStoreInternal.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
7        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn-server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\server\resourcemanager\recovery\TestZKRMStateStoreZKClientConnections$TestZKClient$TestForwardingWatcher.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
8        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\ server\resourcemanager\recovery\TestZKRMStateStoreZKClientConnections$TestZKClient$TestZKRMStateStore.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip
9        : 无法创建文件：D:\hadoop2\hadoop-2.4.0-src\hadoop-yarn- project\hadoop-yarn\hadoop-yarn- server\hadoop-yarn-server-resourcemanager\target\test-classes\org\apache\hadoop\yarn\server\resourcemanager\rmapp\attempt\TestRMAppAttemptTransitions$TestApplicationAttemptEventDispatcher.class：
路径和文件名总长度不能超过260个字符
系统找不到指定的路径。        D:\hadoop2\hadoop-2.4.0-src.zip

2.通过maven获取源码

这里需要说明的是，在使用maven的时候，需要先安装jdk，protoc 


运行

1. mvn eclipse:eclipse -DskipTests

复制代码

这时候注意，我们进入的是hadoop_home,我这里是D:\hadoop2\hadoop-2.4.0-src

部分信息如下

1. [INFO]
   
2. [INFO] ------------------------------------------------------------------------
   
3. [INFO] Reactor Summary:
   
4. [INFO]
   
5. [INFO] Apache Hadoop Main ................................ SUCCESS [  0.684 s]
   
6. [INFO] Apache Hadoop Project POM ......................... SUCCESS [  0.720 s]
   
7. [INFO] Apache Hadoop Annotations ......................... SUCCESS [  0.276 s]
   
8. [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [  0.179 s]
   
9. [INFO] Apache Hadoop Assemblies .......................... SUCCESS [  0.121 s]
   
10. [INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [  1.680 s]
    
11. [INFO] Apache Hadoop MiniKDC ............................. SUCCESS [  1.802 s]
    
12. [INFO] Apache Hadoop Auth ................................ SUCCESS [  1.024 s]
    
13. [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [  0.160 s]
    
14. [INFO] Apache Hadoop Common .............................. SUCCESS [  1.061 s]
    
15. [INFO] Apache Hadoop NFS ................................. SUCCESS [  0.489 s]
    
16. [INFO] Apache Hadoop Common Project ...................... SUCCESS [  0.056 s]
    
17. [INFO] Apache Hadoop HDFS ................................ SUCCESS [  2.770 s]
    
18. [INFO] Apache Hadoop HttpFS .............................. SUCCESS [  0.965 s]
    
19. [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [  0.629 s]
    
20. [INFO] Apache Hadoop HDFS-NFS ............................ SUCCESS [  0.284 s]
    
21. [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [  0.061 s]
    
22. [INFO] hadoop-yarn ....................................... SUCCESS [  0.052 s]
    
23. [INFO] hadoop-yarn-api ................................... SUCCESS [  0.842 s]
    
24. [INFO] hadoop-yarn-common ................................ SUCCESS [  0.322 s]
    
25. [INFO] hadoop-yarn-server ................................ SUCCESS [  0.065 s]
    
26. [INFO] hadoop-yarn-server-common ......................... SUCCESS [  0.972 s]
    
27. [INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [  0.580 s]
    
28. [INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [  0.379 s]
    
29. [INFO] hadoop-yarn-server-applicationhistoryservice ...... SUCCESS [  0.281 s]
    
30. [INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [  0.378 s]
    
31. [INFO] hadoop-yarn-server-tests .......................... SUCCESS [  0.534 s]
    
32. [INFO] hadoop-yarn-client ................................ SUCCESS [  0.307 s]
    
33. [INFO] hadoop-yarn-applications .......................... SUCCESS [  0.050 s]
    
34. [INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [  0.202 s]
    
35. [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS [  0.194 s]
    
36. [INFO] hadoop-yarn-site .................................. SUCCESS [  0.057 s]
    
37. [INFO] hadoop-yarn-project ............................... SUCCESS [  0.066 s]
    
38. [INFO] hadoop-mapreduce-client ........................... SUCCESS [  0.091 s]
    
39. [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [  1.321 s]
    
40. [INFO] hadoop-mapreduce-client-common .................... SUCCESS [  0.786 s]
    
41. [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [  0.456 s]
    
42. [INFO] hadoop-mapreduce-client-app ....................... SUCCESS [  0.508 s]
    
43. [INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [  0.834 s]
    
44. [INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [  0.541 s]
    
45. [INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [  0.284 s]
    
46. [INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [  0.851 s]
    
47. [INFO] hadoop-mapreduce .................................. SUCCESS [  0.099 s]
    
48. [INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [  0.742 s]
    
49. [INFO] Apache Hadoop Distributed Copy .................... SUCCESS [  0.335 s]
    
50. [INFO] Apache Hadoop Archives ............................ SUCCESS [  0.397 s]
    
51. [INFO] Apache Hadoop Rumen ............................... SUCCESS [  0.371 s]
    
52. [INFO] Apache Hadoop Gridmix ............................. SUCCESS [  0.230 s]
    
53. [INFO] Apache Hadoop Data Join ........................... SUCCESS [  0.184 s]
    
54. [INFO] Apache Hadoop Extras .............................. SUCCESS [  0.217 s]
    
55. [INFO] Apache Hadoop Pipes ............................... SUCCESS [  0.048 s]
    
56. [INFO] Apache Hadoop OpenStack support ................... SUCCESS [  0.244 s]
    
57. [INFO] Apache Hadoop Client .............................. SUCCESS [  0.590 s]
    
58. [INFO] Apache Hadoop Mini-Cluster ........................ SUCCESS [  0.230 s]
    
59. [INFO] Apache Hadoop Scheduler Load Simulator ............ SUCCESS [  0.650 s]
    
60. [INFO] Apache Hadoop Tools Dist .......................... SUCCESS [  0.334 s]
    
61. [INFO] Apache Hadoop Tools ............................... SUCCESS [  0.042 s]
    
62. [INFO] Apache Hadoop Distribution ........................ SUCCESS [  0.144 s]
    
63. [INFO] ------------------------------------------------------------------------
    
64. [INFO] BUILD SUCCESS
    
65. [INFO] ------------------------------------------------------------------------
    
66. [INFO] Total time: 31.234 s
    
67. [INFO] Finished at: 2014-06-23T14:55:08+08:00
    
68. [INFO] Final Memory: 84M/759M
    
69. [INFO] ------------------------------------------------------------------------

复制代码

这时候，我们已经把 源码 给下载下来了。这时候，我们会看到文件会明显增大。


 

xiazailiang.png (38.11 KB, 下载次数: 0)

下载附件  保存到相册

2014-6-23 15:01 上传