大数据 Guava冲突问题

最新推荐文章于 2025-09-09 04:01:26 发布

原创最新推荐文章于 2025-09-09 04:01:26 发布 · 1.8k 阅读

0 ·

CC 4.0 BY-SA版权

大数据同时被 3 个专栏收录

38 篇文章

订阅专栏

hbase

6 篇文章

订阅专栏

hadoop

3 篇文章

订阅专栏

本文介绍如何解决Guava与Hadoop/HBase等大数据组件之间的包冲突问题，通过使用Maven Shade Plugin单独构建并重命名Guava jar包，确保项目能够正常运行。

程序使用的guava版本和hadoop hbase大数据之类的包冲突，总是报NoSuchMethod和ClassNoDef之类的错误

解决方法：将依赖的guava-xx.0单独打成jar包，并改名，再重新放回源程序

基于maven-shade-plugin，guava单独打成jar包，修改包路径，并加入源程序的maven本地仓库
1.guava单独打成jar包的pom文件

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
 
    <groupId>com.data.guava</groupId>
    <artifactId>my-guava</artifactId>
    <version>1.0</version>
 
<dependencies>
    <dependency>
        <groupId>com.google.guava</groupId>
        <artifactId>guava</artifactId>
        <version>22.0</version>
    </dependency>
</dependencies>
 
    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>3.1.0</version>
                <configuration>
                    <createDependencyReducedPom>false</createDependencyReducedPom>
                </configuration>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                        <configuration>
                            <relocations>
                                <relocation>
                                    <pattern>com.google.guava</pattern>
                                    <shadedPattern>my.guava</shadedPattern>
                                </relocation>
                                <relocation>
                                    <pattern>com.google.common</pattern>
                                    <shadedPattern>my.guava.common</shadedPattern>
                                </relocation>
                            </relocations>
                            <transformers>
                                <transformer implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer" />
                            </transformers>
                        </configuration>
                    </execution>
                </executions>
            </plugin>
        </plugins>
    </build>
 
</project>

2 install 到本地

mvn install:install-file -Dfile=target/guava-1.0.jar -DgroupId=com.data.guava -DartifactId=my-guava  -Dversion=1.0 -Dpackaging=jar

3.程序中引入


<dependency>
      <groupId>com.data.guava</groupId>
      <artifactId>my-guava</artifactId>
      <version>1.0</version>
    </dependency>

4.修改包路径

//import com.google.common.base.Charsets;
//import com.google.common.hash.BloomFilter;
//import com.google.common.hash.Funnel;
//import com.google.common.hash.PrimitiveSink;
 
import com.data.guava.common.hash.BloomFilter;
import com.data.guava.common.hash.Funnels;