spark2.4.X 安装 mac

首先,在安排前要确保已经安装了java和Scala,因为spark对scala有依赖,而scala对java有依赖。

如果没有安装java,直接去官网下载,然后解压安装,在/etc/profile中添加环境变量。

如果已经安装了java,没有安装scala,则去scala官网下载一份压缩包,把压缩包解压到指定的目录下,然后在etc/profile中添加环境变量。

怎么添加环境变量?随便百度一下就好,答案很多。

java和scala都安装好以后,注意,就可以安装spark了。

这里放一个spark2.4.X的镜像地址:

​​​​​​http://monitor-hdp-bjyf-61-60:50070/explorer.html#/monitor/spark/antispam_sass_log_graph/node/

把对应的安装包下载下来以后,先解压到指定目录。

接下来,重点来了。

切到spark当前的解压目录下,进入conf目录,将spark-env.sh.template重新复制一份,命名成spark-env.sh,然后编辑spark-env.sh,输入以下内容:

export SCALA_HOME= ""  # 引号里是你的scala安装路径

export SPARK_MASTER_IP=localhost

export SPARK_WORKER_MEMORY=4g

最后,把spark的环境变量加到/etc/profile中。

环境变量加好以后,别忘了执行一下:

[root@yfw ~]# cd /opt/openfire/enterprise/Spark-master [root@yfw Spark-master]# cd /opt/openfire/enterprise/Spark-master/ [root@yfw Spark-master]# mvn clean package -DskipTests [INFO] Scanning for projects... [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] Spark (parent) [pom] [INFO] Spark Emoticons [jar] [INFO] Spark Core [jar] [INFO] Spark Plugin Assembly Descriptor [jar] [INFO] Apple Plugin [jar] [INFO] Fastpath [jar] [INFO] Http File Upload Plugin [jar] [INFO] Window Flashing Plugin [jar] [INFO] Growl [jar] [INFO] Online Meetings Plugin [jar] [INFO] Reversi [jar] [INFO] Roar!!! [jar] [INFO] TicTacToe [jar] [INFO] Spellchecker Plugin [jar] [INFO] Transfer Guard [jar] [INFO] Translator Plugin [jar] [INFO] Spark Distribution [jar] [INFO] [INFO] ------------------< org.igniterealtime.spark:parent >------------------- [INFO] Building Spark (parent) 3.0.3-SNAPSHOT [1/17] [INFO] --------------------------------[ pom ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ parent --- [INFO] [INFO] -----------------< org.igniterealtime.spark:emoticons >----------------- [INFO] Building Spark Emoticons 3.0.3-SNAPSHOT [2/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ emoticons --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ emoticons --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/emoticons/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ emoticons --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ emoticons --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/emoticons/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ emoticons --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ emoticons --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ emoticons --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons/emoticons-3.0.3-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ emoticons --- [INFO] Reading assembly descriptor: src/assembly/Default.adiumemoticonset.xml [INFO] Reading assembly descriptor: src/assembly/GTalk.AdiumEmoticonset.xml [INFO] Reading assembly descriptor: src/assembly/POPO.adiumemoticonset.xml [INFO] Reading assembly descriptor: src/assembly/sparkEmoticonSet.xml [INFO] Building zip: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons/emoticons-3.0.3-SNAPSHOT-Default.adiumemoticonset.zip [INFO] Building zip: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons/emoticons-3.0.3-SNAPSHOT-GTalk.AdiumEmoticonset.zip [INFO] Building zip: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons/emoticons-3.0.3-SNAPSHOT-POPO.adiumemoticonset.zip [INFO] Building zip: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base/xtra/emoticons/emoticons-3.0.3-SNAPSHOT-sparkEmoticonSet.zip [INFO] [INFO] ----------------< org.igniterealtime.spark:spark-core >----------------- [INFO] Building Spark Core 3.0.3-SNAPSHOT [3/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/core/target [INFO] [INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @ spark-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 833 resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ spark-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 381 source files to /opt/openfire/enterprise/Spark-master/core/target/classes [INFO] /opt/openfire/enterprise/Spark-master/core/src/main/java/org/jivesoftware/spark/SoundManager.java: 某些输入文件使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/core/src/main/java/org/jivesoftware/spark/SoundManager.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] /opt/openfire/enterprise/Spark-master/core/src/main/java/org/jivesoftware/spark/ui/ChatRoomTransferHandler.java: 某些输入文件使用了未经检查或不安全的操作。 [INFO] /opt/openfire/enterprise/Spark-master/core/src/main/java/org/jivesoftware/spark/ui/ChatRoomTransferHandler.java: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。 [INFO] [INFO] --- maven-resources-plugin:3.1.0:testResources (default-testResources) @ spark-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/core/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ spark-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /opt/openfire/enterprise/Spark-master/core/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ spark-core --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:3.1.2:jar (default-jar) @ spark-core --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/core/target/spark.jar [INFO] [INFO] --- maven-assembly-plugin:3.1.1:single (make-assembly) @ spark-core --- [INFO] Reading assembly descriptor: src/assembly/installation-directory.xml [INFO] Building tar: /opt/openfire/enterprise/Spark-master/core/target/spark-installation-directory.tar [INFO] [INFO] --------< org.igniterealtime.spark.plugins:assembly-descriptor >-------- [INFO] Building Spark Plugin Assembly Descriptor 3.0.3-SNAPSHOT [4/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ assembly-descriptor --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/assembly-descriptor/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ assembly-descriptor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ assembly-descriptor --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ assembly-descriptor --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/assembly-descriptor/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ assembly-descriptor --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ assembly-descriptor --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ assembly-descriptor --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/assembly-descriptor/target/assembly-descriptor-3.0.3-SNAPSHOT.jar [INFO] [INFO] ---------------< org.igniterealtime.spark.plugins:apple >--------------- [INFO] Building Apple Plugin 4.0 [5/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ apple --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/apple/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ apple --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ apple --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /opt/openfire/enterprise/Spark-master/plugins/apple/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/apple/src/main/java/com/jivesoftware/spark/plugin/apple/ApplePlugin.java: /opt/openfire/enterprise/Spark-master/plugins/apple/src/main/java/com/jivesoftware/spark/plugin/apple/ApplePlugin.java使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/apple/src/main/java/com/jivesoftware/spark/plugin/apple/ApplePlugin.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ apple --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/apple/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ apple --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ apple --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ apple --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/apple/target/apple-4.0.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ apple --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/apple/target/apple-4.0-spark-plugin.jar [INFO] [INFO] -------------< org.igniterealtime.spark.plugins:fastpath >-------------- [INFO] Building Fastpath 3.5.1 [6/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ fastpath --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/fastpath/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ fastpath --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 14 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ fastpath --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 44 source files to /opt/openfire/enterprise/Spark-master/plugins/fastpath/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/fastpath/src/main/java/org/jivesoftware/fastpath/workspace/Workpane.java: 某些输入文件使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/fastpath/src/main/java/org/jivesoftware/fastpath/workspace/Workpane.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/fastpath/src/main/java/org/jivesoftware/fastpath/workspace/invite/WorkgroupInvitationDialog.java: 某些输入文件使用了未经检查或不安全的操作。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/fastpath/src/main/java/org/jivesoftware/fastpath/workspace/invite/WorkgroupInvitationDialog.java: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ fastpath --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/fastpath/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ fastpath --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ fastpath --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ fastpath --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/fastpath/target/fastpath-3.5.1.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ fastpath --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/fastpath/target/fastpath-3.5.1-spark-plugin.jar [INFO] [INFO] ------------< org.igniterealtime.spark.plugins:fileupload >------------- [INFO] Building Http File Upload Plugin 0.0.4 [7/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ fileupload --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/fileupload/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ fileupload --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ fileupload --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /opt/openfire/enterprise/Spark-master/plugins/fileupload/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/fileupload/src/main/java/org/jivesoftware/spark/plugin/fileupload/ChatRoomDecorator.java: /opt/openfire/enterprise/Spark-master/plugins/fileupload/src/main/java/org/jivesoftware/spark/plugin/fileupload/ChatRoomDecorator.java使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/fileupload/src/main/java/org/jivesoftware/spark/plugin/fileupload/ChatRoomDecorator.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ fileupload --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/fileupload/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ fileupload --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ fileupload --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ fileupload --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/fileupload/target/fileupload-0.0.4.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ fileupload --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/fileupload/target/fileupload-0.0.4-spark-plugin.jar [INFO] [INFO] -------------< org.igniterealtime.spark.plugins:flashing >-------------- [INFO] Building Window Flashing Plugin 1.3 [8/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ flashing --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/flashing/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ flashing --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 10 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ flashing --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /opt/openfire/enterprise/Spark-master/plugins/flashing/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ flashing --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/flashing/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ flashing --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ flashing --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ flashing --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/flashing/target/flashing-1.3.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ flashing --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/flashing/target/flashing-1.3-spark-plugin.jar [INFO] [INFO] ---------------< org.igniterealtime.spark.plugins:growl >--------------- [INFO] Building Growl 2.4 [9/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ growl --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/growl/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ growl --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/growl/src/main/resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ growl --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to /opt/openfire/enterprise/Spark-master/plugins/growl/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ growl --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/growl/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ growl --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ growl --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ growl --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/growl/target/growl-2.4.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ growl --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/growl/target/growl-2.4-spark-plugin.jar [INFO] [INFO] ---------------< org.igniterealtime.spark.plugins:meet >---------------- [INFO] Building Online Meetings Plugin 0.2.0 [10/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ meet --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/meet/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ meet --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ meet --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /opt/openfire/enterprise/Spark-master/plugins/meet/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/meet/src/main/java/org/jivesoftware/spark/plugin/ofmeet/SparkMeetPlugin.java: /opt/openfire/enterprise/Spark-master/plugins/meet/src/main/java/org/jivesoftware/spark/plugin/ofmeet/SparkMeetPlugin.java使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/meet/src/main/java/org/jivesoftware/spark/plugin/ofmeet/SparkMeetPlugin.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ meet --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/meet/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ meet --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ meet --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ meet --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/meet/target/meet-0.2.0.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ meet --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/meet/target/meet-0.2.0-spark-plugin.jar [INFO] [INFO] --------------< org.igniterealtime.spark.plugins:reversi >-------------- [INFO] Building Reversi 1.6 [11/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ reversi --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/reversi/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ reversi --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 12 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ reversi --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 7 source files to /opt/openfire/enterprise/Spark-master/plugins/reversi/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/reversi/src/main/java/org/jivesoftware/game/reversi/ReversiPanel.java: 某些输入文件使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/reversi/src/main/java/org/jivesoftware/game/reversi/ReversiPanel.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ reversi --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/reversi/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ reversi --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ reversi --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ reversi --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/reversi/target/reversi-1.6.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ reversi --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/reversi/target/reversi-1.6-spark-plugin.jar [INFO] [INFO] ---------------< org.igniterealtime.spark.plugins:roar >---------------- [INFO] Building Roar!!! 1.0 [12/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ roar --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/roar/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ roar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 12 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ roar --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 17 source files to /opt/openfire/enterprise/Spark-master/plugins/roar/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ roar --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/roar/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ roar --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ roar --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ roar --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/roar/target/roar-1.0.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ roar --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/roar/target/roar-1.0-spark-plugin.jar [INFO] [INFO] -------------< org.igniterealtime.spark.plugins:tictactoe >------------- [INFO] Building TicTacToe 0.3 [13/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tictactoe --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/tictactoe/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ tictactoe --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 15 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ tictactoe --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 12 source files to /opt/openfire/enterprise/Spark-master/plugins/tictactoe/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/tictactoe/src/main/java/tic/tac/toe/ui/GamePanel.java: 某些输入文件使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/tictactoe/src/main/java/tic/tac/toe/ui/GamePanel.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tictactoe --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/tictactoe/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ tictactoe --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ tictactoe --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ tictactoe --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/tictactoe/target/tictactoe-0.3.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ tictactoe --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/tictactoe/target/tictactoe-0.3-spark-plugin.jar [INFO] [INFO] -------------< org.igniterealtime.spark.plugins:spelling >-------------- [INFO] Building Spellchecker Plugin 0.8 [14/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spelling --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/spelling/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spelling --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 19 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ spelling --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 8 source files to /opt/openfire/enterprise/Spark-master/plugins/spelling/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spelling --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/spelling/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ spelling --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ spelling --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spelling --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/spelling/target/spelling-0.8.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ spelling --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/spelling/target/spelling-0.8-spark-plugin.jar [INFO] [INFO] -----------< org.igniterealtime.spark.plugins:transferguard >----------- [INFO] Building Transfer Guard 1.2 [15/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ transferguard --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/transferguard/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ transferguard --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 13 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ transferguard --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 5 source files to /opt/openfire/enterprise/Spark-master/plugins/transferguard/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/transferguard/src/main/java/org/jivesoftware/spark/plugins/transfersettings/FileTransferSettingsPlugin.java: /opt/openfire/enterprise/Spark-master/plugins/transferguard/src/main/java/org/jivesoftware/spark/plugins/transfersettings/FileTransferSettingsPlugin.java使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/transferguard/src/main/java/org/jivesoftware/spark/plugins/transfersettings/FileTransferSettingsPlugin.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ transferguard --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/transferguard/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ transferguard --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ transferguard --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ transferguard --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/transferguard/target/transferguard-1.2.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ transferguard --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/transferguard/target/transferguard-1.2-spark-plugin.jar [INFO] [INFO] ------------< org.igniterealtime.spark.plugins:translator >------------- [INFO] Building Translator Plugin 2.0 [16/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ translator --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/plugins/translator/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ translator --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 9 resources [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ translator --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 6 source files to /opt/openfire/enterprise/Spark-master/plugins/translator/target/classes [INFO] /opt/openfire/enterprise/Spark-master/plugins/translator/src/main/java/org/jivesoftware/spark/translator/TranslatorPlugin.java: /opt/openfire/enterprise/Spark-master/plugins/translator/src/main/java/org/jivesoftware/spark/translator/TranslatorPlugin.java使用或覆盖了已过时的 API。 [INFO] /opt/openfire/enterprise/Spark-master/plugins/translator/src/main/java/org/jivesoftware/spark/translator/TranslatorPlugin.java: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。 [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ translator --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/plugins/translator/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ translator --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to /opt/openfire/enterprise/Spark-master/plugins/translator/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ translator --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ translator --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/translator/target/translator-2.0.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ translator --- [INFO] Building jar: /opt/openfire/enterprise/Spark-master/plugins/translator/target/translator-2.0-spark-plugin.jar [INFO] [INFO] ---------------< org.igniterealtime.spark:distribution >---------------- [INFO] Building Spark Distribution 3.0.3-SNAPSHOT [17/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ distribution --- [INFO] Deleting /opt/openfire/enterprise/Spark-master/distribution/target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ distribution --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/distribution/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ distribution --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ distribution --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /opt/openfire/enterprise/Spark-master/distribution/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ distribution --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ distribution --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ distribution --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: /opt/openfire/enterprise/Spark-master/distribution/target/distribution.jar [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (make-assembly) @ distribution --- [INFO] Reading assembly descriptor: src/assembly/basic-distribution.xml [WARNING] The current modules seemed to be having different versions. --> org.igniterealtime.spark.plugins:fastpath:jar:3.5.1 --> org.igniterealtime.spark.plugins:fileupload:jar:0.0.4 --> org.igniterealtime.spark.plugins:flashing:jar:1.3 --> org.igniterealtime.spark.plugins:growl:jar:2.4 --> org.igniterealtime.spark.plugins:meet:jar:0.2.0 --> org.igniterealtime.spark.plugins:reversi:jar:1.6 --> org.igniterealtime.spark.plugins:roar:jar:1.0 --> org.igniterealtime.spark.plugins:tictactoe:jar:0.3 --> org.igniterealtime.spark.plugins:spelling:jar:0.8 --> org.igniterealtime.spark.plugins:transferguard:jar:1.2 --> org.igniterealtime.spark.plugins:translator:jar:2.0 [INFO] Building zip: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base.zip [WARNING] The current modules seemed to be having different versions. --> org.igniterealtime.spark.plugins:fastpath:jar:3.5.1 --> org.igniterealtime.spark.plugins:fileupload:jar:0.0.4 --> org.igniterealtime.spark.plugins:flashing:jar:1.3 --> org.igniterealtime.spark.plugins:growl:jar:2.4 --> org.igniterealtime.spark.plugins:meet:jar:0.2.0 --> org.igniterealtime.spark.plugins:reversi:jar:1.6 --> org.igniterealtime.spark.plugins:roar:jar:1.0 --> org.igniterealtime.spark.plugins:tictactoe:jar:0.3 --> org.igniterealtime.spark.plugins:spelling:jar:0.8 --> org.igniterealtime.spark.plugins:transferguard:jar:1.2 --> org.igniterealtime.spark.plugins:translator:jar:2.0 [INFO] Building tar: /opt/openfire/enterprise/Spark-master/distribution/target/distribution-base.tar.gz [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark (parent) 3.0.3-SNAPSHOT ...................... SUCCESS [ 0.232 s] [INFO] Spark Emoticons .................................... SUCCESS [ 2.125 s] [INFO] Spark Core ......................................... SUCCESS [ 13.522 s] [INFO] Spark Plugin Assembly Descriptor ................... SUCCESS [ 0.035 s] [INFO] Apple Plugin 4.0 ................................... SUCCESS [ 0.762 s] [INFO] Fastpath 3.5.1 ..................................... SUCCESS [ 0.735 s] [INFO] Http File Upload Plugin 0.0.4 ...................... SUCCESS [ 0.291 s] [INFO] Window Flashing Plugin 1.3 ......................... SUCCESS [ 0.355 s] [INFO] Growl 2.4 .......................................... SUCCESS [ 0.605 s] [INFO] Online Meetings Plugin 0.2.0 ....................... SUCCESS [ 0.379 s] [INFO] Reversi 1.6 ........................................ SUCCESS [ 0.414 s] [INFO] Roar!!! 1.0 ........................................ SUCCESS [ 0.341 s] [INFO] TicTacToe 0.3 ...................................... SUCCESS [ 0.438 s] [INFO] Spellchecker Plugin 0.8 ............................ SUCCESS [ 1.480 s] [INFO] Transfer Guard 1.2 ................................. SUCCESS [ 0.257 s] [INFO] Translator Plugin 2.0 .............................. SUCCESS [ 0.729 s] [INFO] Spark Distribution 3.0.3-SNAPSHOT .................. SUCCESS [ 8.157 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 31.108 s [INFO] Finished at: 2025-10-30T15:33:30+08:00 [INFO] ------------------------------------------------------------------------ [root@yfw Spark-master]# ls -la distribution/target/ 总用量 138500 drwxr-xr-x 4 root root 4096 10月 30 15:33 . drwxr-xr-x 4 root root 4096 10月 30 15:33 .. drwxr-xr-x 2 root root 4096 10月 30 15:33 archive-tmp -rw-r--r-- 1 root root 70887223 10月 30 15:33 distribution-base.tar.gz -rw-r--r-- 1 root root 70902044 10月 30 15:33 distribution-base.zip -rw-r--r-- 1 root root 1987 10月 30 15:33 distribution.jar drwxr-xr-x 2 root root 4096 10月 30 15:33 maven-archiver [root@yfw Spark-master]# mkdir spark-client && unzip distribution/target/distribution-base.zip -d spark-client Archive: distribution/target/distribution-base.zip creating: spark-client/distribution/ creating: spark-client/distribution/bin/ creating: spark-client/distribution/resources/ creating: spark-client/distribution/lib/ creating: spark-client/distribution/lib/linux/ creating: spark-client/distribution/lib/mac/ creating: spark-client/distribution/lib/windows64/ creating: spark-client/distribution/lib/linux64/ creating: spark-client/distribution/lib/windows/ creating: spark-client/distribution/plugins/ creating: spark-client/distribution/resources/sounds/ creating: spark-client/distribution/documentation/ creating: spark-client/distribution/documentation/spark guide/ creating: spark-client/distribution/documentation/spark guide/images/ creating: spark-client/distribution/documentation/images/ creating: spark-client/distribution/xtra/ creating: spark-client/distribution/xtra/emoticons/ inflating: spark-client/distribution/bin/startup.bat inflating: spark-client/distribution/bin/startup.sh inflating: spark-client/distribution/resources/Info.plist inflating: spark-client/distribution/resources/jniwrap.dll inflating: spark-client/distribution/resources/jniwrap.lic inflating: spark-client/distribution/resources/startup.bat inflating: spark-client/distribution/resources/startup.sh inflating: spark-client/distribution/resources/systeminfo.dll inflating: spark-client/distribution/lib/linux/libcivil.so inflating: spark-client/distribution/lib/linux/libjng722.so inflating: spark-client/distribution/lib/linux/libjnvpx.so inflating: spark-client/distribution/lib/linux/libjnscreencapture.so inflating: spark-client/distribution/lib/linux/libjnspeex.so inflating: spark-client/distribution/lib/linux/libjnpulseaudio.so inflating: spark-client/distribution/lib/linux/libjnvideo4linux2.so inflating: spark-client/distribution/lib/linux/libjnawtrenderer.so inflating: spark-client/distribution/lib/linux/libjnopus.so inflating: spark-client/distribution/lib/linux/libjnffmpeg.so inflating: spark-client/distribution/lib/linux/libjnportaudio.so inflating: spark-client/distribution/lib/mac/libjng722.jnilib inflating: spark-client/distribution/lib/mac/libSystemUtilities.jnilib inflating: spark-client/distribution/lib/mac/libjnspeex.jnilib inflating: spark-client/distribution/lib/mac/JavaSoundStream.fix.jar inflating: spark-client/distribution/lib/mac/libjnscreencapture.jnilib inflating: spark-client/distribution/lib/mac/libjnopus.jnilib inflating: spark-client/distribution/lib/mac/libjnffmpeg.jnilib inflating: spark-client/distribution/lib/mac/libjnportaudio.jnilib inflating: spark-client/distribution/lib/mac/libjnquicktime.jnilib inflating: spark-client/distribution/lib/mac/libjnawtrenderer.jnilib inflating: spark-client/distribution/lib/mac/libjnmaccoreaudio.jnilib inflating: spark-client/distribution/lib/mac/libjnvpx.jnilib inflating: spark-client/distribution/lib/windows64/jng722.dll inflating: spark-client/distribution/lib/windows64/jnvpx.dll inflating: spark-client/distribution/lib/windows64/jnffmpeg.dll inflating: spark-client/distribution/lib/windows64/civil.dll inflating: spark-client/distribution/lib/windows64/jnopus.dll inflating: spark-client/distribution/lib/windows64/jndirectshow.dll inflating: spark-client/distribution/lib/windows64/jnwasapi.dll inflating: spark-client/distribution/lib/windows64/jnspeex.dll inflating: spark-client/distribution/lib/windows64/jnwincoreaudio.dll inflating: spark-client/distribution/lib/windows64/jnscreencapture.dll inflating: spark-client/distribution/lib/windows64/jnportaudio.dll inflating: spark-client/distribution/lib/windows64/jnawtrenderer.dll inflating: spark-client/distribution/lib/linux64/libcivil.so inflating: spark-client/distribution/lib/linux64/libjng722.so inflating: spark-client/distribution/lib/linux64/libjnvpx.so inflating: spark-client/distribution/lib/linux64/libodbcinst.so inflating: spark-client/distribution/lib/linux64/libjnscreencapture.so inflating: spark-client/distribution/lib/linux64/libodbc.so inflating: spark-client/distribution/lib/linux64/libjnspeex.so inflating: spark-client/distribution/lib/linux64/libjnpulseaudio.so inflating: spark-client/distribution/lib/linux64/libjnvideo4linux2.so inflating: spark-client/distribution/lib/linux64/libjnawtrenderer.so inflating: spark-client/distribution/lib/linux64/libjnopus.so inflating: spark-client/distribution/lib/linux64/libjnffmpeg.so inflating: spark-client/distribution/lib/linux64/libjnportaudio.so inflating: spark-client/distribution/lib/windows/jng722.dll inflating: spark-client/distribution/lib/windows/jnvpx.dll inflating: spark-client/distribution/lib/windows/jnffmpeg.dll inflating: spark-client/distribution/lib/windows/civil.dll inflating: spark-client/distribution/lib/windows/jnopus.dll inflating: spark-client/distribution/lib/windows/jndirectshow.dll inflating: spark-client/distribution/lib/windows/jnwasapi.dll inflating: spark-client/distribution/lib/windows/jnspeex.dll inflating: spark-client/distribution/lib/windows/jnwincoreaudio.dll inflating: spark-client/distribution/lib/windows/jnscreencapture.dll inflating: spark-client/distribution/lib/windows/jnportaudio.dll inflating: spark-client/distribution/lib/windows/jnawtrenderer.dll inflating: spark-client/distribution/resources/sounds/presence_changed.wav inflating: spark-client/distribution/resources/sounds/incoming.wav inflating: spark-client/distribution/resources/sounds/outgoing.wav inflating: spark-client/distribution/resources/sounds/bell.wav inflating: spark-client/distribution/resources/sounds/chat_request.wav inflating: spark-client/distribution/documentation/ide-vscode-setup.html inflating: spark-client/distribution/documentation/ide-intellij-setup.html inflating: spark-client/distribution/documentation/spark guide/images/image021.png inflating: spark-client/distribution/documentation/spark guide/images/image033.png inflating: spark-client/distribution/documentation/spark guide/images/image015.png inflating: spark-client/distribution/documentation/spark guide/images/image003.png inflating: spark-client/distribution/documentation/spark guide/images/image027.png inflating: spark-client/distribution/documentation/spark guide/images/image007.png inflating: spark-client/distribution/documentation/spark guide/images/image001.png inflating: spark-client/distribution/documentation/spark guide/images/image009.png inflating: spark-client/distribution/documentation/spark guide/images/image031.png inflating: spark-client/distribution/documentation/spark guide/images/image011.png inflating: spark-client/distribution/documentation/spark guide/images/image025.png inflating: spark-client/distribution/documentation/spark guide/images/image017.png inflating: spark-client/distribution/documentation/spark guide/images/image029.png inflating: spark-client/distribution/documentation/spark guide/images/image023.png inflating: spark-client/distribution/documentation/spark guide/images/filelist.xml inflating: spark-client/distribution/documentation/spark guide/images/image013.png inflating: spark-client/distribution/documentation/spark guide/images/image005.png inflating: spark-client/distribution/documentation/spark guide/images/image019.png inflating: spark-client/distribution/documentation/spark guide/Spark.default.properties.guide.html inflating: spark-client/distribution/documentation/spark.doap inflating: spark-client/distribution/documentation/changelog.html inflating: spark-client/distribution/documentation/sparkplug_compile.html inflating: spark-client/distribution/documentation/images/IntelliJ-8.JPG inflating: spark-client/distribution/documentation/images/VSCode-4.png inflating: spark-client/distribution/documentation/images/VSCode-6.png inflating: spark-client/distribution/documentation/images/IntelliJ-3.JPG inflating: spark-client/distribution/documentation/images/VSCode-2.png inflating: spark-client/distribution/documentation/images/IntelliJ-10.JPG inflating: spark-client/distribution/documentation/images/login-dialog.png inflating: spark-client/distribution/documentation/images/eclipse-maven-step-1.png inflating: spark-client/distribution/documentation/images/IntelliJ-6.JPG inflating: spark-client/distribution/documentation/images/IntelliJ-1.JPG inflating: spark-client/distribution/documentation/images/contact-list.png inflating: spark-client/distribution/documentation/images/IntelliJ-9.JPG inflating: spark-client/distribution/documentation/images/IntelliJ-5.JPG inflating: spark-client/distribution/documentation/images/VSCode-1.png inflating: spark-client/distribution/documentation/images/chat-room.png inflating: spark-client/distribution/documentation/images/eclipse-maven-step-5.png inflating: spark-client/distribution/documentation/images/VSCode-5.png inflating: spark-client/distribution/documentation/images/eclipse-maven-step-6.png inflating: spark-client/distribution/documentation/images/IntelliJ-2.JPG inflating: spark-client/distribution/documentation/images/banner-spring.gif inflating: spark-client/distribution/documentation/images/eclipse-maven-step-2.png inflating: spark-client/distribution/documentation/images/eclipse-maven-step-3.png inflating: spark-client/distribution/documentation/images/IntelliJ-7.JPG inflating: spark-client/distribution/documentation/images/eclipse-maven-step-4.png inflating: spark-client/distribution/documentation/images/VSCode-3.png inflating: spark-client/distribution/documentation/images/banner-spark.gif inflating: spark-client/distribution/documentation/images/IntelliJ-4.JPG inflating: spark-client/distribution/documentation/sample_plugin_repository.xml inflating: spark-client/distribution/documentation/changes.xsl inflating: spark-client/distribution/documentation/ide-eclipse-setup.html inflating: spark-client/distribution/documentation/style.css inflating: spark-client/distribution/documentation/LICENSE.html inflating: spark-client/distribution/documentation/builder.jar inflating: spark-client/distribution/documentation/sparkplug_dev_guide.html inflating: spark-client/distribution/documentation/README.html inflating: spark-client/distribution/lib/smack-tcp-4.4.8.jar inflating: spark-client/distribution/lib/smack-streammanagement-4.4.8.jar inflating: spark-client/distribution/lib/smack-im-4.4.8.jar inflating: spark-client/distribution/lib/smack-extensions-4.4.8.jar inflating: spark-client/distribution/lib/smack-experimental-4.4.8.jar inflating: spark-client/distribution/lib/hsluv-0.2.jar inflating: spark-client/distribution/lib/smack-debug-4.4.8.jar inflating: spark-client/distribution/lib/smack-debug-slf4j-4.4.8.jar inflating: spark-client/distribution/lib/slf4j-api-1.8.0-beta4.jar inflating: spark-client/distribution/lib/smack-legacy-4.4.8.jar inflating: spark-client/distribution/lib/smack-java8-4.4.8.jar inflating: spark-client/distribution/lib/smack-resolver-javax-4.4.8.jar inflating: spark-client/distribution/lib/smack-xmlparser-stax-4.4.8.jar inflating: spark-client/distribution/lib/smack-sasl-javax-4.4.8.jar inflating: spark-client/distribution/lib/smack-xmlparser-4.4.8.jar inflating: spark-client/distribution/lib/smack-core-4.4.8.jar inflating: spark-client/distribution/lib/minidns-core-1.0.5.jar inflating: spark-client/distribution/lib/jxmpp-core-1.0.3.jar inflating: spark-client/distribution/lib/jxmpp-util-cache-1.0.3.jar inflating: spark-client/distribution/lib/jxmpp-jid-1.0.3.jar inflating: spark-client/distribution/lib/dom4j-2.1.4.jar inflating: spark-client/distribution/lib/httpclient5-5.2.3.jar inflating: spark-client/distribution/lib/httpcore5-h2-5.2.4.jar inflating: spark-client/distribution/lib/httpcore5-5.2.4.jar inflating: spark-client/distribution/lib/commons-lang3-3.15.0.jar inflating: spark-client/distribution/lib/swingx-all-1.6.5-1.jar inflating: spark-client/distribution/lib/jna-platform-5.12.1.jar inflating: spark-client/distribution/lib/jna-5.12.1.jar inflating: spark-client/distribution/lib/xstream-1.4.20.jar inflating: spark-client/distribution/lib/mxparser-1.2.2.jar inflating: spark-client/distribution/lib/xmlpull-1.1.3.1.jar inflating: spark-client/distribution/lib/install4j-runtime-11.0.4.jar inflating: spark-client/distribution/lib/jaxen-1.2.0.jar inflating: spark-client/distribution/lib/LoboBrowser-1.0.0.jar inflating: spark-client/distribution/lib/thumbnailator-0.4.20.jar inflating: spark-client/distribution/lib/bcprov-jdk18on-1.78.1.jar inflating: spark-client/distribution/lib/bcpkix-jdk18on-1.78.1.jar inflating: spark-client/distribution/lib/bcutil-jdk18on-1.78.1.jar inflating: spark-client/distribution/lib/bctls-jdk18on-1.78.1.jar inflating: spark-client/distribution/lib/flatlaf-3.1.1.jar inflating: spark-client/distribution/lib/jaxb-api-2.3.1.jar inflating: spark-client/distribution/lib/javax.activation-api-1.2.0.jar inflating: spark-client/distribution/lib/spark-core-3.0.3-SNAPSHOT.jar inflating: spark-client/distribution/xtra/emoticons/sparkEmoticonSet.zip inflating: spark-client/distribution/xtra/emoticons/POPO.adiumemoticonset.zip inflating: spark-client/distribution/xtra/emoticons/GTalk.AdiumEmoticonset.zip inflating: spark-client/distribution/xtra/emoticons/Default.adiumemoticonset.zip inflating: spark-client/distribution/plugins/apple.jar inflating: spark-client/distribution/plugins/fileupload.jar inflating: spark-client/distribution/plugins/flashing.jar inflating: spark-client/distribution/plugins/growl.jar inflating: spark-client/distribution/plugins/transferguard.jar inflating: spark-client/distribution/plugins/translator.jar inflating: spark-client/distribution/plugins/fastpath.jar inflating: spark-client/distribution/plugins/meet.jar inflating: spark-client/distribution/plugins/reversi.jar inflating: spark-client/distribution/plugins/roar.jar inflating: spark-client/distribution/plugins/tictactoe.jar inflating: spark-client/distribution/plugins/spelling.jar [root@yfw Spark-master]# ls -R spark-client/ spark-client/: distribution spark-client/distribution: bin documentation lib plugins resources xtra spark-client/distribution/bin: startup.bat startup.sh spark-client/distribution/documentation: builder.jar ide-vscode-setup.html spark.doap changelog.html images 'spark guide' changes.xsl LICENSE.html sparkplug_compile.html ide-eclipse-setup.html README.html sparkplug_dev_guide.html ide-intellij-setup.html sample_plugin_repository.xml style.css spark-client/distribution/documentation/images: banner-spark.gif eclipse-maven-step-3.png IntelliJ-2.JPG IntelliJ-8.JPG VSCode-4.png banner-spring.gif eclipse-maven-step-4.png IntelliJ-3.JPG IntelliJ-9.JPG VSCode-5.png chat-room.png eclipse-maven-step-5.png IntelliJ-4.JPG login-dialog.png VSCode-6.png contact-list.png eclipse-maven-step-6.png IntelliJ-5.JPG VSCode-1.png eclipse-maven-step-1.png IntelliJ-10.JPG IntelliJ-6.JPG VSCode-2.png eclipse-maven-step-2.png IntelliJ-1.JPG IntelliJ-7.JPG VSCode-3.png 'spark-client/distribution/documentation/spark guide': images Spark.default.properties.guide.html 'spark-client/distribution/documentation/spark guide/images': filelist.xml image005.png image011.png image017.png image023.png image029.png image001.png image007.png image013.png image019.png image025.png image031.png image003.png image009.png image015.png image021.png image027.png image033.png spark-client/distribution/lib: bcpkix-jdk18on-1.78.1.jar jna-platform-5.12.1.jar smack-im-4.4.8.jar bcprov-jdk18on-1.78.1.jar jxmpp-core-1.0.3.jar smack-java8-4.4.8.jar bctls-jdk18on-1.78.1.jar jxmpp-jid-1.0.3.jar smack-legacy-4.4.8.jar bcutil-jdk18on-1.78.1.jar jxmpp-util-cache-1.0.3.jar smack-resolver-javax-4.4.8.jar commons-lang3-3.15.0.jar linux smack-sasl-javax-4.4.8.jar dom4j-2.1.4.jar linux64 smack-streammanagement-4.4.8.jar flatlaf-3.1.1.jar LoboBrowser-1.0.0.jar smack-tcp-4.4.8.jar hsluv-0.2.jar mac smack-xmlparser-4.4.8.jar httpclient5-5.2.3.jar minidns-core-1.0.5.jar smack-xmlparser-stax-4.4.8.jar httpcore5-5.2.4.jar mxparser-1.2.2.jar spark-core-3.0.3-SNAPSHOT.jar httpcore5-h2-5.2.4.jar slf4j-api-1.8.0-beta4.jar swingx-all-1.6.5-1.jar install4j-runtime-11.0.4.jar smack-core-4.4.8.jar thumbnailator-0.4.20.jar javax.activation-api-1.2.0.jar smack-debug-4.4.8.jar windows jaxb-api-2.3.1.jar smack-debug-slf4j-4.4.8.jar windows64 jaxen-1.2.0.jar smack-experimental-4.4.8.jar xmlpull-1.1.3.1.jar jna-5.12.1.jar smack-extensions-4.4.8.jar xstream-1.4.20.jar spark-client/distribution/lib/linux: libcivil.so libjng722.so libjnpulseaudio.so libjnvideo4linux2.so libjnawtrenderer.so libjnopus.so libjnscreencapture.so libjnvpx.so libjnffmpeg.so libjnportaudio.so libjnspeex.so spark-client/distribution/lib/linux64: libcivil.so libjng722.so libjnpulseaudio.so libjnvideo4linux2.so libodbc.so libjnawtrenderer.so libjnopus.so libjnscreencapture.so libjnvpx.so libjnffmpeg.so libjnportaudio.so libjnspeex.so libodbcinst.so spark-client/distribution/lib/mac: JavaSoundStream.fix.jar libjng722.jnilib libjnportaudio.jnilib libjnspeex.jnilib libjnawtrenderer.jnilib libjnmaccoreaudio.jnilib libjnquicktime.jnilib libjnvpx.jnilib libjnffmpeg.jnilib libjnopus.jnilib libjnscreencapture.jnilib libSystemUtilities.jnilib spark-client/distribution/lib/windows: civil.dll jndirectshow.dll jng722.dll jnportaudio.dll jnspeex.dll jnwasapi.dll jnawtrenderer.dll jnffmpeg.dll jnopus.dll jnscreencapture.dll jnvpx.dll jnwincoreaudio.dll spark-client/distribution/lib/windows64: civil.dll jndirectshow.dll jng722.dll jnportaudio.dll jnspeex.dll jnwasapi.dll jnawtrenderer.dll jnffmpeg.dll jnopus.dll jnscreencapture.dll jnvpx.dll jnwincoreaudio.dll spark-client/distribution/plugins: apple.jar fileupload.jar growl.jar reversi.jar spelling.jar transferguard.jar fastpath.jar flashing.jar meet.jar roar.jar tictactoe.jar translator.jar spark-client/distribution/resources: Info.plist jniwrap.dll jniwrap.lic sounds startup.bat startup.sh systeminfo.dll spark-client/distribution/resources/sounds: bell.wav chat_request.wav incoming.wav outgoing.wav presence_changed.wav spark-client/distribution/xtra: emoticons spark-client/distribution/xtra/emoticons: Default.adiumemoticonset.zip GTalk.AdiumEmoticonset.zip POPO.adiumemoticonset.zip sparkEmoticonSet.zip [root@yfw Spark-master]#
最新发布
10-31
### 回答1: Spark 3.x与Spark 2.x的区别主要有以下几点: 1. 支持Python 3:Spark 3.x支持Python 3,而Spark 2.x只支持Python 22. 更好的性能:Spark 3.x在性能方面有所提升,包括更快的查询速度和更高的并行度。 3. 更好的SQL支持:Spark 3.x引入了一些新的SQL功能,包括ANSI SQL支持、更好的窗口函数支持和更好的类型推断。 4. 更好的流处理支持:Spark 3.x引入了一些新的流处理功能,包括更好的状态管理和更好的容错性。 5. 更好的机器学习支持:Spark 3.x引入了一些新的机器学习功能,包括更好的特征工程支持和更好的模型解释性。 总的来说,Spark 3.x相对于Spark 2.x来说是一个更加成熟和功能更加丰富的版本。 ### 回答2Spark 3.x与Spark 2.x有很多显著的不同之处。 首先,Spark 3.x通过引入新的API和更好的优化器提高了性能和可伸缩性。 其次,它更易于使用,使开发人员更容易使用Spark构建复杂的应用程序。以下是Spark 3.x与Spark 2.x的主要区别: 1.新的API: Spark 3.x引入了一些新的API,如Delta Lake、Kubernetes、Pandas UDF等。Delta Lake是一个开源数据湖解决方案,使数据管理、可靠性和性能变得更加容易。有了Kubernetes,Spark可以更好地与容器化环境集成。同时,Pandas UDF支持Python的Pandas库,可以处理大量的数据。 2.优化器的改进: Spark 3.x引入了新的优化器(称为Spark 3.0 Optimizer),可显著提高查询性能。这个优化器使用基于规则的优化技术和成本模型,通过优化查询来提高查询性能。 3.支持更多的数据源: Spark 3.x做了很多工作来改进数据源API。它提供了更广泛的数据源支持,包括Apache Kafka、Amazon S3、Google BigQuery等。 4.增强了机器学习功能: Spark 3.x提供了更多的基于机器学习的库和工具,包括Python的Pandas和Scikit-Learn库的元数据集成,支持PySpark的PythonML库等。 5.交互式查询支持: Spark 3.x引入了新的交互式查询API,这使得Spark变得更加友好。您可以使用Spark SQL进行查询,该工具支持批处理和流处理查询。 总之,Spark 3.x相比Spark 2.x更加强大和易于使用。它提供了更多的API、更好的优化器和更好的可扩展性。这些变化使得Spark在处理大数据方面更加卓越,让开发人员更轻松地构建复杂的应用程序。 ### 回答3: Apache Spark是一个快速、通用,基于内存的分布式计算系统,已成为大数据领域中最受欢迎的计算框架之一。Spark 3.x是Apache Spark计算框架的最新版本,相比于之前的版本有很多新的特性和功能,以下是Spark 3.x与Spark 2.x的主要区别。 1. Python API重构 Python是Apache Spark中最受欢迎的编程语言,但它在之前的版本中没有得到很好的支持。在Spark 3.x中,Python API被重构,在性能和易用性方面都有了大幅改善。 2. 完全支持SQL ANSI标准 Spark 3.x从核心到应用都支持SQL ANSI标准。这意味着,Spark 3.x支持更多的SQL函数和操作,并且更加符合SQL标准。 3. 兼容性增强 Spark 3.x不再依赖于Hadoop,这意味着它能够更好地与其他数据源进行集成。同时,它也支持Kubernetes和Docker的容器化部署方式。 4. AI支持增加 Spark 3.x引入了许多新的机器学习和深度学习算法,例如支持自动编码器和多标签分类器的模型,以及更好的分布式模型训练功能。 5. 其它特性 Spark 3.x还支持Delta Lake,这是一个可靠、高性能的事务性存储。同时,它还提供性能更好的Spark流式处理API和更好的结构化API,这些API在处理大规模结构化数据时更加高效。 总之,Spark 3.x相比于Spark 2.x在性能、兼容性、AI支持和其它特性方面都有很大的改进。无论是开发人员还是数据科学家,Spark 3.x都能够提供更好的用户体验和更高的数据处理效率。
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值