Hadoop java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils

最新推荐文章于 2021-03-02 17:05:19 发布
最新推荐文章于 2021-03-02 17:05:19 发布
阅读量946 收藏 1
点赞数
CC 4.0 BY-SA版权
文章标签： 大数据 java
原文链接：http://www.cnblogs.com/144823836yj/p/10626503.html
在使用Hadoop运行好友推荐案例时，出现找不到org.apache.commons.lang3.StringUtils类的问题，导致任务失败。该问题通常是因为运行环境缺少必要的commons-lang3-3.3.2.jar依赖文件。

摘要生成于 C知道 ，由 DeepSeek-R1 满血版支持， 前往体验 >

commons-lang3-3.3.2.jar 学习好友推荐案例的时候，提交运行时报错找不到StringUtils

java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
[root@node01 ~]# hadoop jar MyFOF.jar com.sxt.hadoop.mr.fof.MyFOF
19/03/30 00:25:37 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
19/03/30 00:25:37 INFO input.FileInputFormat: Total input paths to process : 1
19/03/30 00:25:38 INFO mapreduce.JobSubmitter: number of splits:1
19/03/30 00:25:38 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1553914110426_0006
19/03/30 00:25:38 INFO impl.YarnClientImpl: Submitted application application_1553914110426_0006
19/03/30 00:25:38 INFO mapreduce.Job: The url to track the job: http://node03:8088/proxy/application_1553914110426_0006/
19/03/30 00:25:38 INFO mapreduce.Job: Running job: job_1553914110426_0006
19/03/30 00:25:51 INFO mapreduce.Job: Job job_1553914110426_0006 running in uber mode : false
19/03/30 00:25:51 INFO mapreduce.Job:  map 0% reduce 0%
19/03/30 00:26:01 INFO mapreduce.Job: Task Id : attempt_1553914110426_0006_m_000000_0, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
    at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:20)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

19/03/30 00:26:14 INFO mapreduce.Job: Task Id : attempt_1553914110426_0006_m_000000_1, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
    at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:20)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

19/03/30 00:26:24 INFO mapreduce.Job: Task Id : attempt_1553914110426_0006_m_000000_2, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
    at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:20)
    at com.sxt.hadoop.mr.fof.FMapper.map(FMapper.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

19/03/30 00:26:35 INFO mapreduce.Job:  map 100% reduce 100%
19/03/30 00:26:35 INFO mapreduce.Job: Job job_1553914110426_0006 failed with state FAILED due to: Task failed task_1553914110426_0006_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

19/03/30 00:26:35 INFO mapreduce.Job: Counters: 16
    Job Counters 
        Failed map tasks=4
        Killed reduce tasks=1
        Launched map tasks=4
        Other local map tasks=3
        Data-local map tasks=1
        Total time spent by all maps in occupied slots (ms)=36188
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=36188
        Total time spent by all reduce tasks (ms)=0
        Total vcore-milliseconds taken by all map tasks=36188
        Total vcore-milliseconds taken by all reduce tasks=0
        Total megabyte-milliseconds taken by all map tasks=37056512
        Total megabyte-milliseconds taken by all reduce tasks=0
    Map-Reduce Framework
        CPU time spent (ms)=0
        Physical memory (bytes) snapshot=0
        Virtual memory (bytes) snapshot=0

 

编译时没问题，提交运行错误，说明在运行环境中找不到StringUtils。

解决办法：

从/opt/sxt/hadoop-2.7.7/share/hadoop/tools/lib目录下拷贝commons-lang3-3.3.2.jar到opt/sxt/hadoop-2.7.7/share/hadoop/common/lib目录下，然后将commons-lang3-3.3.2.jar分别拷贝到各DataNode[root@node01 lib]# scp commons-lang3-3.3.2.jar node02:`pwd`

commons-lang3-3.3.2.jar                                                                    100%  403KB   8.1MB/s   00:00
[root@node01 lib]# scp commons-lang3-3.3.2.jar node03:`pwd`
commons-lang3-3.3.2.jar    　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　100%  403KB   7.6MB/s   00:00

[root@node01 lib]# scp commons-lang3-3.3.2.jar node04:`pwd`
commons-lang3-3.3.2.jar                               　　　　　　　　　　　　　　　　　　　　　　100%  403KB   7.0MB/s   00:00 

转载于:https://www.cnblogs.com/144823836yj/p/10626503.html

sqoop报错Caused by: java.lang.ClassNotFoundException: org.apache.tez.dag.api.SessionNotRunning
yy的博客
11-02 2326
问题: hive切换引擎为tez之后,sqoop导入数据到内部表报错Caused by: java.lang.ClassNotFoundException: org.apache.tez.dag.api.SessionNotRunning 解决方法: vim /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/sqoop/conf/hive-site.xml 修改下面参数为mr: (这里不要使用hive/conf下的h...
Web项目整合Hbase报错java.lang.ClassNotFoundException
l-jobs的专栏
05-03 1417
问题描述：在idea上运行web项目，本来以为使用maven引入habse的包就行了，这样编译可以通过。没想到在运行时抛出错误，说NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration<dependency> <groupId>org.apache.hbase</groupId> ...
java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils 一个错误引发的血案 struts2-blank的所有 包
热门推荐
JEFFYU328的专栏
07-06 2万+
我新建了一个项目，还没有业务，只有web.xml配置，struts.xml的配置只是随便点···出了个错··· java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils 我出了这么一个错，不知道是什么包不对，还是哪里配置不对。于是我找错，我百度，有网友说是可能web.xml或包不够·····其中有个老兄说，把app
Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
游海东的技术专栏
07-10 7377
1、错误描述 2014-7-10 23:12:23 org.apache.catalina.core.StandardContext filterStart 严重: Exception starting filter struts2 java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils at com.opens
java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils
evilcry2012的专栏
07-23 1570
struts2中的错误--java.lang.NoClassDefFoundError: org/apache/commons/lang3/StringUtils (2013-04-07 10:16:38) 转载▼ 标签：  365   it   2013-4-7 10:13:56 org.apache.catalin
java.lang.NoClassDefFoundError: org/apache/commons/io/output/UnsynchronizedByteArrayOutputStream java.lang.ClassNotFoundException: org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream
最新发布
06-27
我们遇到了一个关于`java.lang.NoClassDefFoundError`和`java.lang.ClassNotFoundException`的错误，具体是找不到`org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream`类。这个类属于...
[root@hadoop01 bin]# sqoop list-databases --connect jdbc:mysql://localhost:3306 --username root -p Warning: /export/servers/sqoop/../hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /export/servers/sqoop/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /export/servers/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 2025-06-16 17:41:30,249 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7 2025-06-16 17:41:30,316 ERROR tool.BaseSqoopTool: Error parsing arguments for list-databases: 2025-06-16 17:41:30,316 ERROR tool.BaseSqoopTool: Unrecognized argument: -p Try --help for usage instructions. [root@hadoop01 bin]# vi $SQOOP_HOME/conf/sqoop-env.sh [root@hadoop01 bin]# sqoop version Warning: /export/servers/sqoop/../hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /export/servers/sqoop/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /export/servers/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 2025-06-16 17:57:06,080 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7 Sqoop 1.4.7 git commit id 2328971411f57f0cb683dfb79d19d4d19d185dd8 Compiled by maugli on Thu Dec 21 15:59:58 STD 2017 [root@hadoop01 bin]# sqoop list-databases --connect jdbc:mysql://localhost:3306 --username root -P Warning: /export/servers/sqoop/../hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /export/servers/sqoop/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /export/servers/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 2025-06-16 17:57:25,507 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7 Enter password: 2025-06-16 17:57:32,492 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils at org.apache.sqoop.manager.MySQLManager.initOptionDefaults(MySQLManager.java:73) at org.apache.sqoop.manager.SqlManager.<init>(SqlManager.java:89) at com.cloudera.sqoop.manager.SqlManager.<init>(SqlManager.java:33) at org.apache.sqoop.manager.GenericJdbcManager.<init>(GenericJdbcManager.java:51) at com.cloudera.sqoop.manager.GenericJdbcManager.<init>(GenericJdbcManager.java:30) at org.apache.sqoop.manager.CatalogQueryManager.<init>(CatalogQueryManager.java:46) at com.cloudera.sqoop.manager.CatalogQueryManager.<init>(CatalogQueryManager.java:31) at org.apache.sqoop.manager.InformationSchemaManager.<init>(InformationSchemaManager.java:38) at com.cloudera.sqoop.manager.InformationSchemaManager.<init>(InformationSchemaManager.java:31) at org.apache.sqoop.manager.MySQLManager.<init>(MySQLManager.java:65) at org.apache.sqoop.manager.DefaultManagerFactory.accept(DefaultManagerFactory.java:67) at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:184) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:272) at org.apache.sqoop.tool.ListDatabasesTool.run(ListDatabasesTool.java:44) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at org.apache.sqoop.Sqoop.main(Sqoop.java:252) Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 20 more
06-17
我们正在解决Sqoop连接MySQL时出现的`java.lang.NoClassDefFoundError:org/apache/commons/lang/StringUtils`错误。根据引用[1]和引用[2]的信息，这个错误的原因是Sqoop缺少`commons-lang`的旧版本（2.x）的类`...
在学习hadoop中遇到的问题
qq_35573689的博客
08-02 3236
错误内容包括mapreduce、hive、flume、azkaban、sqoop、 1 启动程序报错: 19/08/02 16:19:12 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicab...
commons-lang3-3.1 StringUtils字符串jar包
02-06
commons-lang3-3.1 StringUtils字符串jar包 org.apache.commons.lang3.StringUtils的jar包
org.apache.commons.lang3.StringUtils.jar.rar
05-23
org.apache.commons.lang3.StringUtils.jar,打开是common-lang3.jar文件，以及使用方法，根据使用方法使用即可，绝对可靠
java.lang.ClassNotFoundException%3A+org.apache.commons.lang3.StringUtils
ManonLiu
03-02 589
解决办法：在pom文件中添加相关依赖 <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-lang3</artifactId> <version>3.11</version> </dependency> ...
错误: java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils
weixin_30416871的博客
08-16 2182
做项目的时候，实现图片异步上传并返回json数据，但是图片上传成功，json数据没有返回，报错： java.lang.ClassNotFoundException: org.apache.commons.lang3.StringUtils 网上查找后，原因是：缺少commons-lang3-3.1.jar包 将“commons-lang3-3.1.jar”复制到文件夹lib目录下，运行，可...
commons-lang3-3.1.jar在BuildPath导入后运行仍报错：ClassNotFoundException: org.apache.commons.lang3.StringUtil
波板糖的博客
03-09 2331
解决办法：        Build Path 加入的是编译需要的包，比如import *********.StringUtils 如果没有相应的包，则在编译的时候会报错；当在Build Path里导入了包，但没有把包放入WEB-INF/lib目录下，则在运行时会报ClassNotFoundException的异常。所以，在项目中，如果要使用StringUtils工具类，或其他类，API,需
java.lang.ClassNotFoundException：org.apache.hadoop.hbase.zookeeper.ZKClusterId
06-24
我们正在解决一个Java运行时异常：java.lang.ClassNotFoundException:org.apache.hadoop.hbase.zookeeper.ZKClusterId根据引用[1][2][3]的类似问题解决方案，我们可以推断出这类问题通常是由于缺少相关的JAR包或者类...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值