内置jetty server下solrcloud6.2.1和Zookeeper集群的安装和配置过程详解

本文详细介绍了如何在CentOS 6.8环境下搭建Zookeeper集群并安装配置SolrCloud,包括环境准备、Zookeeper集群安装步骤、Solr安装配置、中文分词器配置等关键环节。
环境介绍:
两台虚拟机:192.168.0.1和192.168.0.2
系统和软件版本:centos6.8 zookeeper-3.4.10 solr-6.2.1

一.zookeeper集群安装
下载 zookeeper-3.4.10并解压
# cd /data/solrcloud/
# tar zxvf zookeeper-3.4.10.tar.gz

在zookeeper目录里创建 data和log目录用于存放数据
# cd /data/solrcloud/zookeeper-3.4.10
# mkdir -p data log

拷贝zookeeper的配置文件zoo_sample.cfg为zoo.cfg
# cp conf/zoo_sample.cfg  conf/zoo.cfg

编辑配置文件zoo.cfg,并加入如下内容:
vi conf/zoo.cfg

dataDir=/data/solrcloud/zookeeper-3.4.10/data
dataLogDir=/data/solrcloud/zookeeper-3.4.10/log

server.1=192.168.0.1:2888:3888
server.2=192.168.0.2:2888:3888

保存退出

在zookeeper中的data目录里需要创建myid文件,并写入对应的数字
conf/zoo.cfg里:
server.1对应的机器上写入1
server.2对应的机器上写入2

192.168.0.1上写入1
#cd /data/solrcloud/zookeeper-3.4.10/data
# echo 1 > myid

同理,另外一台写入2:
# echo 2 > myid

分别在两台机器上启动zookeeper集群
# cd /data/solrcloud/zookeeper-3.4.10/bin
# ./zkServer.sh start

查看集群状态
# ./zkServer.sh status

安装成功应该是一个为leader,1个为follower
# ./zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /data/solrcloud/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: leader

另外一台:
]# ./zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /data/solrcloud/zookeeper-3.4.10/bin/../conf/zoo.cfg
Mode: follower

solrcould安装

解压solr-6.2.1.tgz并重命名为solr,然后修改bin目录下的solr.in.sh文件内容:
SOLR_JAVA_MEM="-Xms10G -Xmx10G" (此处根据内存大小做适当修改,本例为10G)
加入ZK_HOST
ZK_HOST="192.168.0.1:2181,192.168.0.2:2181"
去掉 ZK_CLIENT_TIMEOUT 的注释
ZK_CLIENT_TIMEOUT="15000"

配置solr中文分词器
拷贝IKAnalyzer-2016_FS.jar文件到solr/server/solr-webapp/webapp/WEB-INF/lib目录下


创建用于存放上传的配置文件的solrhome目录,然后拷贝配置文件
# mkdir -p /data/solrcloud/solrhome/myconf
# cp -r /data/solrcloud/solr/example/example-DIH/solr/solr/conf  /data/solrcloud/solrhome/myconf

myconf中conf下的solrconfig.xml及managed-schema内容需要修改,具体内容可以参考以下配置:

 managed-schema内容:
<?xml version="1.0" encoding="UTF-8"?>
<!-- Solr managed schema - automatically generated - DO NOT EDIT -->
<schema name="nutch" version="1.6">
  <uniqueKey>kvUuid</uniqueKey>
  <defaultSearchField>kvTitle</defaultSearchField>
  <solrQueryParser defaultOperator="AND"/>
  <fieldType name="ancestor_path" class="solr.TextField">
    <analyzer type="index">
      <tokenizer class="solr.KeywordTokenizerFactory"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.PathHierarchyTokenizerFactory" delimiter="/"/>
    </analyzer>
  </fieldType>
  <fieldType name="binary" class="solr.BinaryField"/>
  <fieldType name="boolean" class="solr.BoolField" sortMissingLast="true"/>
  <fieldType name="booleans" class="solr.BoolField" sortMissingLast="true" multiValued="true"/>
  <fieldType name="currency" class="solr.CurrencyField" currencyConfig="currency.xml" defaultCurrency="USD" precisionStep="8"/>
  <fieldType name="date" class="solr.TrieDateField" positionIncrementGap="0" docValues="true" precisionStep="0"/>
  <fieldType name="dates" class="solr.TrieDateField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="0"/>
  <fieldType name="descendent_path" class="solr.TextField">
    <analyzer type="index">
      <tokenizer class="solr.PathHierarchyTokenizerFactory" delimiter="/"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.KeywordTokenizerFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="double" class="solr.TrieDoubleField" positionIncrementGap="0" docValues="true" precisionStep="0"/>
  <fieldType name="doubles" class="solr.TrieDoubleField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="0"/>
  <fieldType name="float" class="solr.TrieFloatField" positionIncrementGap="0" docValues="true" precisionStep="0"/>
  <fieldType name="floats" class="solr.TrieFloatField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="0"/>
  <fieldType name="ignored" class="solr.StrField" indexed="false" stored="false" docValues="false" multiValued="true"/>
  <fieldType name="int" class="solr.TrieIntField" positionIncrementGap="0" docValues="true" precisionStep="0"/>
  <fieldType name="ints" class="solr.TrieIntField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="0"/>
  <fieldType name="location" class="solr.LatLonType" subFieldSuffix="_coordinate"/>
  <fieldType name="location_rpt" class="solr.SpatialRecursivePrefixTreeFieldType" geo="true" maxDistErr="0.001" distErrPct="0.025" distanceUnits="kilometers"/>
  <fieldType name="long" class="solr.TrieLongField" positionIncrementGap="0" docValues="true" precisionStep="0"/>
  <fieldType name="longs" class="solr.TrieLongField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="0"/>
  <fieldType name="lowercase" class="solr.TextField" positionIncrementGap="100">
    <analyzer>
      <tokenizer class="solr.KeywordTokenizerFactory"/>
      <filter class="solr.LowerCaseFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="phonetic_en" class="solr.TextField" indexed="true" stored="false">
    <analyzer>
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.DoubleMetaphoneFilterFactory" inject="false"/>
    </analyzer>
  </fieldType>
  <fieldType name="point" class="solr.PointType" subFieldSuffix="_d" dimension="2"/>
  <fieldType name="random" class="solr.RandomSortField" indexed="true"/>
  <fieldType name="string" class="solr.StrField" sortMissingLast="true" docValues="true"/>
  <fieldType name="strings" class="solr.StrField" sortMissingLast="true" docValues="true" multiValued="true"/>
  <fieldType name="tdate" class="solr.TrieDateField" positionIncrementGap="0" docValues="true" precisionStep="6"/>
  <fieldType name="tdates" class="solr.TrieDateField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="6"/>
  <fieldType name="tdouble" class="solr.TrieDoubleField" positionIncrementGap="0" docValues="true" precisionStep="8"/>
  <fieldType name="tdoubles" class="solr.TrieDoubleField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="8"/>
  <fieldType name="text_en" class="solr.TextField" positionIncrementGap="100">
    <analyzer type="index">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.StopFilterFactory" words="lang/stopwords_en.txt" ignoreCase="true"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.EnglishPossessiveFilterFactory"/>
      <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
      <filter class="solr.PorterStemFilterFactory"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.SynonymFilterFactory" expand="true" ignoreCase="true" synonyms="synonyms.txt"/>
      <filter class="solr.StopFilterFactory" words="lang/stopwords_en.txt" ignoreCase="true"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.EnglishPossessiveFilterFactory"/>
      <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
      <filter class="solr.PorterStemFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_en_splitting" class="solr.TextField" autoGeneratePhraseQueries="true" positionIncrementGap="100">
    <analyzer type="index">
      <tokenizer class="solr.WhitespaceTokenizerFactory"/>
      <filter class="solr.StopFilterFactory" words="lang/stopwords_en.txt" ignoreCase="true"/>
      <filter class="solr.WordDelimiterFilterFactory" catenateNumbers="1" generateNumberParts="1" splitOnCaseChange="1" generateWordParts="1" catenateAll="0" catenateWords="1"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
      <filter class="solr.PorterStemFilterFactory"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.WhitespaceTokenizerFactory"/>
      <filter class="solr.SynonymFilterFactory" expand="true" ignoreCase="true" synonyms="synonyms.txt"/>
      <filter class="solr.StopFilterFactory" words="lang/stopwords_en.txt" ignoreCase="true"/>
      <filter class="solr.WordDelimiterFilterFactory" catenateNumbers="0" generateNumberParts="1" splitOnCaseChange="1" generateWordParts="1" catenateAll="0" catenateWords="0"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
      <filter class="solr.PorterStemFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_en_splitting_tight" class="solr.TextField" autoGeneratePhraseQueries="true" positionIncrementGap="100">
    <analyzer>
      <tokenizer class="solr.WhitespaceTokenizerFactory"/>
      <filter class="solr.SynonymFilterFactory" expand="false" ignoreCase="true" synonyms="synonyms.txt"/>
      <filter class="solr.StopFilterFactory" words="lang/stopwords_en.txt" ignoreCase="true"/>
      <filter class="solr.WordDelimiterFilterFactory" catenateNumbers="1" generateNumberParts="0" generateWordParts="0" catenateAll="0" catenateWords="1"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
      <filter class="solr.EnglishMinimalStemFilterFactory"/>
      <filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_general" class="solr.TextField" positionIncrementGap="100" multiValued="true">
    <analyzer type="index">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/>
      <filter class="solr.LowerCaseFilterFactory"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/>
      <filter class="solr.SynonymFilterFactory" expand="true" ignoreCase="true" synonyms="synonyms.txt"/>
      <filter class="solr.LowerCaseFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_general_rev" class="solr.TextField" positionIncrementGap="100">
    <analyzer type="index">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/>
      <filter class="solr.LowerCaseFilterFactory"/>
      <filter class="solr.ReversedWildcardFilterFactory" maxPosQuestion="2" maxFractionAsterisk="0.33" maxPosAsterisk="3" withOriginal="true"/>
    </analyzer>
    <analyzer type="query">
      <tokenizer class="solr.StandardTokenizerFactory"/>
      <filter class="solr.SynonymFilterFactory" expand="true" ignoreCase="true" synonyms="synonyms.txt"/>
      <filter class="solr.StopFilterFactory" words="stopwords.txt" ignoreCase="true"/>
      <filter class="solr.LowerCaseFilterFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_ws" class="solr.TextField" positionIncrementGap="100">
    <analyzer>
      <tokenizer class="solr.WhitespaceTokenizerFactory"/>
    </analyzer>
  </fieldType>
  <fieldType name="text_zh" class="solr.TextField">
    <analyzer class="org.wltea.analyzer.lucene.IKAnalyzer"/>
  </fieldType>
  <fieldType name="tfloat" class="solr.TrieFloatField" positionIncrementGap="0" docValues="true" precisionStep="8"/>
  <fieldType name="tfloats" class="solr.TrieFloatField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="8"/>
  <fieldType name="tint" class="solr.TrieIntField" positionIncrementGap="0" docValues="true" precisionStep="8"/>
  <fieldType name="tints" class="solr.TrieIntField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="8"/>
  <fieldType name="tlong" class="solr.TrieLongField" positionIncrementGap="0" docValues="true" precisionStep="8"/>
  <fieldType name="tlongs" class="solr.TrieLongField" positionIncrementGap="0" docValues="true" multiValued="true" precisionStep="8"/>
  <field name="ARTICLEID" type="string" indexed="true" stored="true"/>
  <field name="ARTICLESITE" type="text_zh" indexed="true" stored="true"/>
  <field name="ARTICLESITEID" type="string" indexed="true" stored="true"/>
  <field name="CLASSLYID" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="DATATYPE" type="string" indexed="true" stored="true"/>
  <field name="FILEPATH" type="string" indexed="false" stored="true"/>
  <field name="JZ" type="string" indexed="true" stored="true"/>
  <field name="MUTISITE" type="text_zh" indexed="true" stored="true"/>
  <field name="_version_" type="long" indexed="true" stored="false"/>
  <field name="copy_cday" type="string" indexed="true" stored="false"/>
  <field name="copy_chour" type="string" indexed="true" stored="false"/>
  <field name="copy_cmonth" type="string" indexed="true" stored="false"/>
  <field name="copy_cyear" type="string" indexed="true" stored="false"/>
  <field name="copy_site" type="string" indexed="true" stored="false"/>
  <field name="copy_source" type="string" indexed="true" stored="false"/>
  <field name="copy_title" type="string" indexed="true" stored="false"/>
  <field name="ismyattention" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="isread" type="int" indexed="true" stored="true"/>
  <field name="isyj" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="keyword" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="krInfotype" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="krIslocal" type="int" indexed="true" stored="true"/>
  <field name="krKeywordid" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="krState" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="krUid" type="string" multiValued="true" indexed="true" stored="true"/>
  <field name="kvAbstract" type="text_zh" indexed="true" stored="true"/>
  <field name="kvAuthor" type="text_zh" indexed="true" stored="true"/>
  <field name="kvCollection" type="int" indexed="true" stored="true"/>
  <field name="kvContent" type="text_zh" indexed="true" stored="true"/>
  <field name="kvCtime" type="string" indexed="true" stored="true"/>
  <field name="kvDkTime" type="string" indexed="true" stored="true"/>
  <field name="kvISYJ" type="int" indexed="false" stored="true"/>
  <field name="kvOrienLevel" type="int" indexed="true" stored="true"/>
  <field name="kvOrientation" type="int" indexed="true" stored="true"/>
  <field name="kvReply" type="int" indexed="true" stored="true"/>
  <field name="kvSite" type="text_zh" indexed="true" stored="true"/>
  <field name="kvSource" type="text_zh" indexed="true" stored="true"/>
  <field name="kvSourcetype" type="int" indexed="true" stored="true"/>
  <field name="kvState" type="string" indexed="true" stored="true"/>
  <field name="kvTitle" type="text_zh" indexed="true" stored="true"/>
  <field name="kvUrl" type="string" indexed="false" stored="true"/>
  <field name="kvUserPic" type="string" indexed="false" stored="true"/>
  <field name="kvUuid" type="string" indexed="true" stored="true"/>
  <field name="kvVisitcount" type="int" indexed="true" stored="true"/>
  <field name="retweetedStatusUrl" type="string" indexed="true" stored="true"/>
  <field name="text" type="string" indexed="true" stored="true"/>
  <field name="wechatInfoType" type="int" indexed="true" stored="true"/>
  <dynamicField name="*_txt_en_split_tight" type="text_en_splitting_tight" indexed="true" stored="true"/>
  <dynamicField name="*_descendent_path" type="descendent_path" indexed="true" stored="true"/>
  <dynamicField name="*_ancestor_path" type="ancestor_path" indexed="true" stored="true"/>
  <dynamicField name="*_txt_en_split" type="text_en_splitting" indexed="true" stored="true"/>
  <dynamicField name="*_coordinate" type="tdouble" indexed="true" stored="false" useDocValuesAsStored="false"/>
  <dynamicField name="ignored_*" type="ignored" multiValued="true"/>
  <dynamicField name="*_txt_rev" type="text_general_rev" indexed="true" stored="true"/>
  <dynamicField name="*_phon_en" type="phonetic_en" indexed="true" stored="true"/>
  <dynamicField name="*_s_lower" type="lowercase" indexed="true" stored="true"/>
  <dynamicField name="random_*" type="random"/>
  <dynamicField name="*_txt_en" type="text_en" indexed="true" stored="true"/>
  <dynamicField name="*_txt_zh" type="text_zh" indexed="true" stored="true"/>
  <dynamicField name="*_point" type="point" indexed="true" stored="true"/>
  <dynamicField name="*_srpt" type="location_rpt" indexed="true" stored="true"/>
  <dynamicField name="*_tdts" type="tdates" indexed="true" stored="true"/>
  <dynamicField name="attr_*" type="text_general" multiValued="true" indexed="true" stored="true"/>
  <dynamicField name="*_txt" type="text_general" indexed="true" stored="true"/>
  <dynamicField name="*_dts" type="date" multiValued="true" indexed="true" stored="true"/>
  <dynamicField name="*_tis" type="tints" indexed="true" stored="true"/>
  <dynamicField name="*_tls" type="tlongs" indexed="true" stored="true"/>
  <dynamicField name="*_tfs" type="tfloats" indexed="true" stored="true"/>
  <dynamicField name="*_tds" type="tdoubles" indexed="true" stored="true"/>
  <dynamicField name="*_tdt" type="tdate" indexed="true" stored="true"/>
  <dynamicField name="*_is" type="ints" indexed="true" stored="true"/>
  <dynamicField name="*_ss" type="strings" indexed="true" stored="true"/>
  <dynamicField name="*_ls" type="longs" indexed="true" stored="true"/>
  <dynamicField name="*_bs" type="booleans" indexed="true" stored="true"/>
  <dynamicField name="*_fs" type="floats" indexed="true" stored="true"/>
  <dynamicField name="*_ds" type="doubles" indexed="true" stored="true"/>
  <dynamicField name="*_dt" type="date" indexed="true" stored="true"/>
  <dynamicField name="*_ti" type="tint" indexed="true" stored="true"/>
  <dynamicField name="*_tl" type="tlong" indexed="true" stored="true"/>
  <dynamicField name="*_tf" type="tfloat" indexed="true" stored="true"/>
  <dynamicField name="*_td" type="tdouble" indexed="true" stored="true"/>
  <dynamicField name="*_ws" type="text_ws" indexed="true" stored="true"/>
  <dynamicField name="*_i" type="int" indexed="true" stored="true"/>
  <dynamicField name="*_s" type="string" indexed="true" stored="true"/>
  <dynamicField name="*_l" type="long" indexed="true" stored="true"/>
  <dynamicField name="*_t" type="text_general" indexed="true" stored="true"/>
  <dynamicField name="*_b" type="boolean" indexed="true" stored="true"/>
  <dynamicField name="*_f" type="float" indexed="true" stored="true"/>
  <dynamicField name="*_d" type="double" indexed="true" stored="true"/>
  <dynamicField name="*_p" type="location" indexed="true" stored="true"/>
  <dynamicField name="*_c" type="currency" indexed="true" stored="true"/>
  <copyField source="kvSite" dest="copy_site"/>
  <copyField source="kvSource" dest="copy_source"/>
  <copyField source="kvTitle" dest="copy_title"/>
</schema>

启动solrcloud
# # cd /data/solrcloud/solr/bin
./solr start -cloud -z 192.168.0.1:2181,192.168.0.2:2181 -p 8080

创建带有三分片和1个副本的topic和chenfeng集合:
./solr create_collection -c topic -shards 3 -replicationFactor 1 -p 8080
./solr create_collection -c chenfeng -shards 3 -replicationFactor 1 -p 8080

进入cloud-scripts目录并上传配置文件到zookeeper:
# cd /data/solrcloud/solr/server/scripts/cloud-scripts
# ./zkcli.sh   -zkhost   192.168.0.1:2281,192.168.0.2:2181  -cmd   upconfig  -confdir  /data/solrcloud/solr/server/solr/configsets/basic_configs/conf -confname  topic
# ./zkcli.sh   -zkhost   192.168.0.1:2281,192.168.0.2:2181  -cmd   upconfig  -confdir  /data/solrcloud/solr/server/solr/configsets/basic_configs/conf -confname  chenfeng

登陆zookeeper集群查看上传的文件:
# cd /data/solrcloud/zookeeper-3.4.10/bin
# ./zkCli.sh
Connecting to localhost:2181
2018-01-25 17:13:33,212 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2018-01-25 17:13:33,216 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=<NA>
2018-01-25 17:13:33,216 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_161
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-3.b14.el6_9.x86_64/jre
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/data/solrcloud/zookeeper-3.4.10/bin/../build/classes:/data/solrcloud/zookeeper-3.4.10/bin/../build/lib/*.jar:/data/solrcloud/zookeeper-3.4.10/bin/../lib/slf4j-log4j12-1.6.1.jar:/data/solrcloud/zookeeper-3.4.10/bin/../lib/slf4j-api-1.6.1.jar:/data/solrcloud/zookeeper-3.4.10/bin/../lib/netty-3.10.5.Final.jar:/data/solrcloud/zookeeper-3.4.10/bin/../lib/log4j-1.2.16.jar:/data/solrcloud/zookeeper-3.4.10/bin/../lib/jline-0.9.94.jar:/data/solrcloud/zookeeper-3.4.10/bin/../zookeeper-3.4.10.jar:/data/solrcloud/zookeeper-3.4.10/bin/../src/java/lib/*.jar:/data/solrcloud/zookeeper-3.4.10/bin/../conf:
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2018-01-25 17:13:33,218 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=2.6.32-642.el6.x86_64
2018-01-25 17:13:33,219 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2018-01-25 17:13:33,219 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2018-01-25 17:13:33,219 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/data/solrcloud/zookeeper-3.4.10/bin
2018-01-25 17:13:33,220 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@277050dc
Welcome to ZooKeeper!
2018-01-25 17:13:33,240 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1032] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2018-01-25 17:13:33,297 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@876] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
2018-01-25 17:13:33,305 [myid:] - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@1299] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x1612c33f9f2000a, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: localhost:2181(CONNECTED) 0] ls /configs
[topic, chenfeng]
[zk: localhost:2181(CONNECTED) 1] ls /configs/topic
[currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt, elevate.xml, stopwords.txt, lang, params.json]
[zk: localhost:2181(CONNECTED) 2] ls /configs/chenfeng
[currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt, elevate.xml, stopwords.txt, lang, params.json]
[zk: localhost:2181(CONNECTED) 3] quit
Quitting...
2018-01-25 17:13:51,512 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x1612c33f9f2000a closed
2018-01-25 17:13:51,514 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@519] - EventThread shut down for session: 0x1612c33f9f2000a


查看solr集群页面:
http://192.168.0.1:8080/solr/#/~collections/chenfeng
http://192.168.0.1:8080/solr/#/~collections/topic

在界面上点reload重新加载配置文件,然后刷新页面。
至此solrcloud安装完毕。

来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/15498/viewspace-2150530/,如需转载,请注明出处,否则将追究法律责任。

转载于:http://blog.itpub.net/15498/viewspace-2150530/

我在配置虚拟机Hadoop,目前遇到问题了,帮我分析一下。[root@master bin]# su ./start-dfs.sh su: user ./start-dfs.sh does not exist [root@master bin]# hdfs namenode -format WARNING: /export/server/hadoop/logs does not exist. Creating. 2025-10-14 03:15:33,652 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = master/192.168.80.130 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.1.3 STARTUP_MSG: classpath = /export/server/hadoop/etc/hadoop:/export/server/hadoop/share/hadoop/common/lib/accessors-smart-1.2.jar:/export/server/hadoop/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/export/server/hadoop/share/hadoop/common/lib/asm-5.0.4.jar:/export/server/hadoop/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/export/server/hadoop/share/hadoop/common/lib/avro-1.7.7.jar:/export/server/hadoop/share/hadoop/common/lib/checker-qual-2.5.2.jar:/export/server/hadoop/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/export/server/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/export/server/hadoop/share/hadoop/common/lib/commons-codec-1.11.jar:/export/server/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar:/export/server/hadoop/share/hadoop/common/lib/commons-compress-1.18.jar:/export/server/hadoop/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/export/server/hadoop/share/hadoop/common/lib/commons-io-2.5.jar:/export/server/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar:/export/server/hadoop/share/hadoop/common/lib/commons-lang3-3.4.jar:/export/server/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar:/export/server/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar:/export/server/hadoop/share/hadoop/common/lib/commons-net-3.6.jar:/export/server/hadoop/share/hadoop/common/lib/curator-client-2.13.0.jar:/export/server/hadoop/share/hadoop/common/lib/curator-framework-2.13.0.jar:/export/server/hadoop/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/export/server/hadoop/share/hadoop/common/lib/error_prone_annotations-2.2.0.jar:/export/server/hadoop/share/hadoop/common/lib/failureaccess-1.0.jar:/export/server/hadoop/share/hadoop/common/lib/gson-2.2.4.jar:/export/server/hadoop/share/hadoop/common/lib/guava-27.0-jre.jar:/export/server/hadoop/share/hadoop/common/lib/hadoop-annotations-3.1.3.jar:/export/server/hadoop/share/hadoop/common/lib/hadoop-auth-3.1.3.jar:/export/server/hadoop/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/export/server/hadoop/share/hadoop/common/lib/httpclient-4.5.2.jar:/export/server/hadoop/share/hadoop/common/lib/httpcore-4.4.4.jar:/export/server/hadoop/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-core-2.7.8.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/export/server/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/export/server/hadoop/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/export/server/hadoop/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/export/server/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/export/server/hadoop/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/export/server/hadoop/share/hadoop/common/lib/jersey-core-1.19.jar:/export/server/hadoop/share/hadoop/common/lib/jersey-json-1.19.jar:/export/server/hadoop/share/hadoop/common/lib/jersey-server-1.19.jar:/export/server/hadoop/share/hadoop/common/lib/jersey-servlet-1.19.jar:/export/server/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/common/lib/jsch-0.1.54.jar:/export/server/hadoop/share/hadoop/common/lib/json-smart-2.3.jar:/export/server/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/export/server/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar:/export/server/hadoop/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-client-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-common-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-core-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-server-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerb-util-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerby-config-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerby-util-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/export/server/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/export/server/hadoop/share/hadoop/common/lib/netty-3.10.5.Final.jar:/export/server/hadoop/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/export/server/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/export/server/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/export/server/hadoop/share/hadoop/common/lib/re2j-1.1.jar:/export/server/hadoop/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/export/server/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/export/server/hadoop/share/hadoop/common/lib/snappy-java-1.0.5.jar:/export/server/hadoop/share/hadoop/common/lib/stax2-api-3.1.4.jar:/export/server/hadoop/share/hadoop/common/lib/token-provider-1.0.1.jar:/export/server/hadoop/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/export/server/hadoop/share/hadoop/common/lib/zookeeper-3.4.13.jar:/export/server/hadoop/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/export/server/hadoop/share/hadoop/common/lib/metrics-core-3.2.4.jar:/export/server/hadoop/share/hadoop/common/hadoop-common-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/common/hadoop-common-3.1.3.jar:/export/server/hadoop/share/hadoop/common/hadoop-nfs-3.1.3.jar:/export/server/hadoop/share/hadoop/common/hadoop-kms-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs:/export/server/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/export/server/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/export/server/hadoop/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/export/server/hadoop/share/hadoop/hdfs/lib/okio-1.6.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/export/server/hadoop/share/hadoop/hdfs/lib/hadoop-auth-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/export/server/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/export/server/hadoop/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/export/server/hadoop/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/json-smart-2.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/export/server/hadoop/share/hadoop/hdfs/lib/asm-5.0.4.jar:/export/server/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/export/server/hadoop/share/hadoop/hdfs/lib/curator-framework-2.13.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/curator-client-2.13.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/export/server/hadoop/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/export/server/hadoop/share/hadoop/hdfs/lib/error_prone_annotations-2.2.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-io-2.5.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/export/server/hadoop/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/export/server/hadoop/share/hadoop/hdfs/lib/hadoop-annotations-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-net-3.6.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jettison-1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/export/server/hadoop/share/hadoop/hdfs/lib/avro-1.7.7.jar:/export/server/hadoop/share/hadoop/hdfs/lib/paranamer-2.3.jar:/export/server/hadoop/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/export/server/hadoop/share/hadoop/hdfs/lib/commons-compress-1.18.jar:/export/server/hadoop/share/hadoop/hdfs/lib/re2j-1.1.jar:/export/server/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/gson-2.2.4.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/export/server/hadoop/share/hadoop/hdfs/lib/curator-recipes-2.13.0.jar:/export/server/hadoop/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/export/server/hadoop/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/export/server/hadoop/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/export/server/hadoop/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.3.jar:/export/server/hadoop/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.3-tests.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.1.3.jar:/export/server/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn:/export/server/hadoop/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/export/server/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/export/server/hadoop/share/hadoop/yarn/lib/dnsjava-2.1.7.jar:/export/server/hadoop/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/export/server/hadoop/share/hadoop/yarn/lib/fst-2.50.jar:/export/server/hadoop/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/export/server/hadoop/share/hadoop/yarn/lib/guice-4.0.jar:/export/server/hadoop/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/export/server/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/export/server/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/export/server/hadoop/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/export/server/hadoop/share/hadoop/yarn/lib/java-util-1.9.0.jar:/export/server/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/export/server/hadoop/share/hadoop/yarn/lib/jersey-client-1.19.jar:/export/server/hadoop/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/export/server/hadoop/share/hadoop/yarn/lib/json-io-2.5.1.jar:/export/server/hadoop/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/export/server/hadoop/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/export/server/hadoop/share/hadoop/yarn/lib/objenesis-1.0.jar:/export/server/hadoop/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/export/server/hadoop/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-api-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-client-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-common-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-registry-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-router-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-services-api-3.1.3.jar:/export/server/hadoop/share/hadoop/yarn/hadoop-yarn-services-core-3.1.3.jar STARTUP_MSG: build = https://gitbox.apache.org/repos/asf/hadoop.git -r ba631c436b806728f8ec2f54ab1e289526c90579; compiled by 'ztang' on 2019-09-12T02:47Z STARTUP_MSG: java = 1.8.0_241 ************************************************************/ 2025-10-14 03:15:33,677 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT] 2025-10-14 03:15:33,821 ERROR conf.Configuration: error parsing conf core-site.xml com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at com.ctc.wstx.sr.StreamScanner.throwUnexpectedEOF(StreamScanner.java:687) at com.ctc.wstx.sr.BasicStreamReader.throwUnexpectedEOF(BasicStreamReader.java:5608) at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2802) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1123) at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3320) at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3114) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3007) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1812) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1789) at org.apache.hadoop.util.ShutdownHookManager.getShutdownTimeout(ShutdownHookManager.java:183) at org.apache.hadoop.util.ShutdownHookManager$HookEntry.<init>(ShutdownHookManager.java:207) at org.apache.hadoop.util.ShutdownHookManager.addShutdownHook(ShutdownHookManager.java:304) at org.apache.hadoop.util.StringUtils.startupShutdownMessage(StringUtils.java:723) at org.apache.hadoop.util.StringUtils.startupShutdownMessage(StringUtils.java:707) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1754) 2025-10-14 03:15:33,824 ERROR namenode.NameNode: Failed to start namenode. java.lang.RuntimeException: com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3024) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1812) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1789) at org.apache.hadoop.util.ShutdownHookManager.getShutdownTimeout(ShutdownHookManager.java:183) at org.apache.hadoop.util.ShutdownHookManager$HookEntry.<init>(ShutdownHookManager.java:207) at org.apache.hadoop.util.ShutdownHookManager.addShutdownHook(ShutdownHookManager.java:304) at org.apache.hadoop.util.StringUtils.startupShutdownMessage(StringUtils.java:723) at org.apache.hadoop.util.StringUtils.startupShutdownMessage(StringUtils.java:707) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1754) Caused by: com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at com.ctc.wstx.sr.StreamScanner.throwUnexpectedEOF(StreamScanner.java:687) at com.ctc.wstx.sr.BasicStreamReader.throwUnexpectedEOF(BasicStreamReader.java:5608) at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2802) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1123) at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3320) at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3114) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3007) ... 11 more 2025-10-14 03:15:33,899 INFO util.ExitUtil: Exiting with status 1: java.lang.RuntimeException: com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] 2025-10-14 03:15:33,918 ERROR conf.Configuration: error parsing conf core-site.xml com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at com.ctc.wstx.sr.StreamScanner.throwUnexpectedEOF(StreamScanner.java:687) at com.ctc.wstx.sr.BasicStreamReader.throwUnexpectedEOF(BasicStreamReader.java:5608) at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2802) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1123) at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3320) at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3114) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3007) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1812) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1789) at org.apache.hadoop.util.ShutdownHookManager.getShutdownTimeout(ShutdownHookManager.java:183) at org.apache.hadoop.util.ShutdownHookManager.shutdownExecutor(ShutdownHookManager.java:145) at org.apache.hadoop.util.ShutdownHookManager.access$300(ShutdownHookManager.java:65) at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:102) Exception in thread "Thread-1" java.lang.RuntimeException: com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3024) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1812) at org.apache.hadoop.conf.Configuration.getTimeDuration(Configuration.java:1789) at org.apache.hadoop.util.ShutdownHookManager.getShutdownTimeout(ShutdownHookManager.java:183) at org.apache.hadoop.util.ShutdownHookManager.shutdownExecutor(ShutdownHookManager.java:145) at org.apache.hadoop.util.ShutdownHookManager.access$300(ShutdownHookManager.java:65) at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:102) Caused by: com.ctc.wstx.exc.WstxEOFException: Unexpected EOF; was expecting a close tag for element <configuration> at [row,col,system-id]: [31,0,"file:/export/server/hadoop/etc/hadoop/core-site.xml"] at com.ctc.wstx.sr.StreamScanner.throwUnexpectedEOF(StreamScanner.java:687) at com.ctc.wstx.sr.BasicStreamReader.throwUnexpectedEOF(BasicStreamReader.java:5608) at com.ctc.wstx.sr.BasicStreamReader.nextFromTree(BasicStreamReader.java:2802) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1123) at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3320) at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3114) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3007) ... 9 more [root@master bin]# cd /sbin [root@master sbin]# start-dfs.sh -bash: /usr/sbin/start-dfs.sh: 权限不够 [root@master sbin]# sudo start-dfs.sh sudo: start-dfs.sh:找不到命令 [root@master sbin]# vi core-site.xml [root@master sbin]# cd /export/server [root@master server]# vi core-site.xml [root@master server]# vi hdfs-site.xml [root@master server]# cd /export/server/hadoop/etc/hadoop/ [root@master hadoop]# ls capacity-scheduler.xml kms-log4j.properties configuration.xsl kms-site.xml container-executor.cfg log4j.properties core-site.xml mapred-env.cmd hadoop-env.cmd mapred-env.sh hadoop-env.sh mapred-queues.xml.template hadoop-metrics2.properties mapred-site.xml hadoop-policy.xml shellprofile.d hadoop-user-functions.sh.example ssl-client.xml.example hdfs-site.xml ssl-server.xml.example httpfs-env.sh user_ec_policies.xml.template httpfs-log4j.properties workers httpfs-signature.secret yarn-env.cmd httpfs-site.xml yarn-env.sh kms-acls.xml yarnservice-log4j.properties kms-env.sh yarn-site.xml [root@master hadoop]# vi core-site.xml [root@master hadoop]# cd /sbin [root@master sbin]# start-dfs.sh -bash: /usr/sbin/start-dfs.sh: 权限不够 [root@master sbin]# sudo chomd +x /usr/sbin/start-dfs.sh sudo: chomd:找不到命令 [root@master sbin]# chomd +x /usr/sbin/start-dfs.sh -bash: chomd: 未找到命令 [root@master sbin]# chmod +x /usr/sbin/start-dfs.sh [root@master sbin]# start-dfs.sh [root@master sbin]# jps 18301 Jps [root@master sbin]# ../start-dfs.sh -bash: ../start-dfs.sh: 没有那个文件或目录 [root@master sbin]# ./start-dfs.sh [root@master sbin]# jps 18872 Jps [root@master sbin]#
10-15
运行后报错: D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\bin\java.exe "-javaagent:D:\2025.9\JAVA\IDEA 2023.1\IntelliJ IDEA 2023.1\lib\idea_rt.jar=65137:D:\2025.9\JAVA\IDEA 2023.1\IntelliJ IDEA 2023.1\bin" -Dfile.encoding=UTF-8 -classpath D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\charsets.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\deploy.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\access-bridge-64.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\cldrdata.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\dnsns.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\jaccess.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\jfxrt.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\localedata.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\nashorn.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\sunec.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\sunjce_provider.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\sunmscapi.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\sunpkcs11.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\ext\zipfs.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\javaws.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\jce.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\jfr.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\jfxswt.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\jsse.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\management-agent.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\plugin.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\resources.jar;D:\2025.9\Hadoop\test\4\jdk1.8\jdk1.8\jdk1.8.0_181\jre\lib\rt.jar;D:\2025.9\Hadoop\java\hadoop_project\out\production\hadoop_project;D:\2025.9\Hadoop\test\4\lib2\fst-2.50.jar;D:\2025.9\Hadoop\test\4\lib2\re2j-1.1.jar;D:\2025.9\Hadoop\test\4\lib2\asm-5.0.4.jar;D:\2025.9\Hadoop\test\4\lib2\guice-4.0.jar;D:\2025.9\Hadoop\test\4\lib2\jna-5.2.0.jar;D:\2025.9\Hadoop\test\4\lib2\avro-1.7.7.jar;D:\2025.9\Hadoop\test\4\lib2\gson-2.8.9.jar;D:\2025.9\Hadoop\test\4\lib2\okio-2.8.0.jar;D:\2025.9\Hadoop\test\4\lib2\jline-3.9.0.jar;D:\2025.9\Hadoop\test\4\lib2\jsch-0.1.55.jar;D:\2025.9\Hadoop\test\4\lib2\asm-tree-9.1.jar;D:\2025.9\Hadoop\test\4\lib2\jettison-1.1.jar;D:\2025.9\Hadoop\test\4\lib2\jsr305-3.0.2.jar;D:\2025.9\Hadoop\test\4\lib2\log4j-1.2.17.jar;D:\2025.9\Hadoop\test\4\lib2\okhttp-4.9.3.jar;D:\2025.9\Hadoop\test\4\lib2\dnsjava-2.1.7.jar;D:\2025.9\Hadoop\test\4\lib2\ehcache-3.3.1.jar;D:\2025.9\Hadoop\test\4\lib2\json-io-2.5.1.jar;D:\2025.9\Hadoop\test\4\lib2\objenesis-2.6.jar;D:\2025.9\Hadoop\test\4\lib2\paranamer-2.3.jar;D:\2025.9\Hadoop\test\4\lib2\guava-27.0-jre.jar;D:\2025.9\Hadoop\test\4\lib2\javax.inject-1.jar;D:\2025.9\Hadoop\test\4\lib2\snakeyaml-1.26.jar;D:\2025.9\Hadoop\test\4\lib2\aopalliance-1.0.jar;D:\2025.9\Hadoop\test\4\lib2\asm-commons-9.1.jar;D:\2025.9\Hadoop\test\4\lib2\commons-cli-1.2.jar;D:\2025.9\Hadoop\test\4\lib2\commons-net-3.6.jar;D:\2025.9\Hadoop\test\4\lib2\httpcore-4.4.13.jar;D:\2025.9\Hadoop\test\4\lib2\java-util-1.9.0.jar;D:\2025.9\Hadoop\test\4\lib2\jaxb-api-2.2.11.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-core-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-util-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerby-xdr-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\reload4j-1.2.22.jar;D:\2025.9\Hadoop\test\4\lib2\stax2-api-4.2.1.jar;D:\2025.9\Hadoop\test\4\lib2\zookeeper-3.5.6.jar;D:\2025.9\Hadoop\test\4\lib2\asm-analysis-9.1.jar;D:\2025.9\Hadoop\test\4\lib2\commons-io-2.8.0.jar;D:\2025.9\Hadoop\test\4\lib2\commons-text-1.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-kms-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-nfs-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-core-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-json-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\json-smart-2.4.7.jar;D:\2025.9\Hadoop\test\4\lib2\jsr311-api-1.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-admin-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerby-asn1-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerby-pkix-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerby-util-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\slf4j-api-1.7.36.jar;D:\2025.9\Hadoop\test\4\lib2\failureaccess-1.0.jar;D:\2025.9\Hadoop\test\4\lib2\guice-servlet-4.0.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-auth-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\httpclient-4.5.13.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-xc-1.9.13.jar;D:\2025.9\Hadoop\test\4\lib2\jaxb-impl-2.2.3-1.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-guice-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\json-simple-1.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-client-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-common-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-crypto-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-server-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\checker-qual-2.5.2.jar;D:\2025.9\Hadoop\test\4\lib2\commons-codec-1.15.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-client-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-server-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\kerby-config-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\leveldbjni-all-1.8.jar;D:\2025.9\Hadoop\test\4\lib2\metrics-core-3.2.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-3.10.6.Final.jar;D:\2025.9\Hadoop\test\4\lib2\bcpkix-jdk15on-1.60.jar;D:\2025.9\Hadoop\test\4\lib2\bcprov-jdk15on-1.60.jar;D:\2025.9\Hadoop\test\4\lib2\commons-math3-3.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-common-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-core-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\jersey-servlet-1.19.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-identity-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\protobuf-java-2.5.0.jar;D:\2025.9\Hadoop\test\4\lib2\snappy-java-1.1.8.2.jar;D:\2025.9\Hadoop\test\4\lib2\woodstox-core-5.3.0.jar;D:\2025.9\Hadoop\test\4\lib2\commons-lang3-3.12.0.jar;D:\2025.9\Hadoop\test\4\lib2\curator-client-4.2.0.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-jaxrs-1.9.13.jar;D:\2025.9\Hadoop\test\4\lib2\kerb-simplekdc-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\kotlin-stdlib-1.4.10.jar;D:\2025.9\Hadoop\test\4\lib2\token-provider-1.0.1.jar;D:\2025.9\Hadoop\test\4\lib2\zookeeper-jute-3.5.6.jar;D:\2025.9\Hadoop\test\4\lib2\accessors-smart-2.4.7.jar;D:\2025.9\Hadoop\test\4\lib2\commons-compress-1.21.jar;D:\2025.9\Hadoop\test\4\lib2\commons-daemon-1.0.13.jar;D:\2025.9\Hadoop\test\4\lib2\commons-logging-1.1.3.jar;D:\2025.9\Hadoop\test\4\lib2\curator-recipes-4.2.0.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-nfs-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-rbf-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-registry-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-api-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\HikariCP-java7-2.4.12.jar;D:\2025.9\Hadoop\test\4\lib2\mssql-jdbc-6.2.1.jre7.jar;D:\2025.9\Hadoop\test\4\lib2\nimbus-jose-jwt-9.8.1.jar;D:\2025.9\Hadoop\test\4\lib2\slf4j-reload4j-1.7.36.jar;D:\2025.9\Hadoop\test\4\lib2\j2objc-annotations-1.1.jar;D:\2025.9\Hadoop\test\4\lib2\jcip-annotations-1.0-1.jar;D:\2025.9\Hadoop\test\4\lib2\netty-all-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\commons-beanutils-1.9.4.jar;D:\2025.9\Hadoop\test\4\lib2\curator-framework-4.2.0.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-core-asl-1.9.13.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-databind-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\javax.servlet-api-3.1.0.jar;D:\2025.9\Hadoop\test\4\lib2\javax.websocket-api-1.0.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-annotations-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-client-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-httpfs-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-client-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-common-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\commons-collections-3.2.2.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-common-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-shaded-guava-1.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-jaxrs-base-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-mapper-asl-1.9.13.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-io-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-buffer-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-common-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\swagger-annotations-1.5.4.jar;D:\2025.9\Hadoop\test\4\lib2\audience-annotations-0.5.0.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-registry-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-annotations-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\jakarta.xml.bind-api-2.3.2.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-xml-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-handler-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-rbf-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-http-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-jndi-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-plus-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-util-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\kotlin-stdlib-common-1.4.10.jar;D:\2025.9\Hadoop\test\4\lib2\netty-resolver-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\commons-configuration2-2.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\jakarta.activation-api-1.2.1.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-dns-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-xml-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-client-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-server-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-webapp-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-http-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-mqtt-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-smtp-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-client-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-tests-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-services-api-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\javax.websocket-client-api-1.0.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-servlet-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-http2-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-redis-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-socks-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-stomp-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\websocket-api-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\animal-sniffer-annotations-1.17.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-native-client-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-examples-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-common-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-router-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-services-core-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-security-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-resolver-dns-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-hs-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-shaded-protobuf_3_7-1.1.1.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-util-ajax-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-haproxy-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-handler-proxy-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-udt-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-app-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-codec-memcache-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-rxtx-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-sctp-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\websocket-client-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\websocket-common-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\websocket-server-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-core-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-web-proxy-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-jaxrs-json-provider-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\jetty-annotations-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\websocket-servlet-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\geronimo-jcache_1.0_spec-1.0-alpha-1.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-common-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-nodemanager-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-hdfs-native-client-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-shuffle-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-uploader-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\jackson-module-jaxb-annotations-2.12.7.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-jobclient-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-hs-plugins-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-nativetask-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-applications-mawo-core-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-resourcemanager-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-classes-epoll-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-sharedcachemanager-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-classes-kqueue-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\javax-websocket-client-impl-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\javax-websocket-server-impl-9.4.43.v20210629.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-mapreduce-client-jobclient-3.3.4-tests.jar;D:\2025.9\Hadoop\test\4\lib2\netty-resolver-dns-classes-macos-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-applications-distributedshell-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-timeline-pluginstorage-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-native-unix-common-4.1.77.Final.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-server-applicationhistoryservice-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\hadoop-yarn-applications-unmanaged-am-launcher-3.3.4.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-native-kqueue-4.1.77.Final-osx-x86_64.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-native-epoll-4.1.77.Final-linux-x86_64.jar;D:\2025.9\Hadoop\test\4\lib2\netty-resolver-dns-native-macos-4.1.77.Final-osx-x86_64.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-native-kqueue-4.1.77.Final-osx-aarch_64.jar;D:\2025.9\Hadoop\test\4\lib2\netty-transport-native-epoll-4.1.77.Final-linux-aarch_64.jar;D:\2025.9\Hadoop\test\4\lib2\netty-resolver-dns-native-macos-4.1.77.Final-osx-aarch_64.jar;D:\2025.9\Hadoop\test\4\lib2\listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar WordCount 2025-10-28 19:39:15,026 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-10-28 19:39:20,641 WARN [main] impl.MetricsConfig (MetricsConfig.java:loadFirst(136)) - Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties,hadoop-metrics2.properties 2025-10-28 19:39:20,684 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(378)) - Scheduled Metric snapshot period at 10 second(s). 2025-10-28 19:39:20,684 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:start(191)) - JobTracker metrics system started Exception in thread "main" ExitCodeException exitCode=-1073741515: at org.apache.hadoop.util.Shell.runCommand(Shell.java:1007) at org.apache.hadoop.util.Shell.run(Shell.java:900) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.util.Shell.execCommand(Shell.java:1306) at org.apache.hadoop.util.Shell.execCommand(Shell.java:1288) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:978) at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:660) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:700) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:672) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:699) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:672) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:699) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:672) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:699) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:677) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:336) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:162) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:113) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:148) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1571) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1568) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1568) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1589) at WordCount.main(WordCount.java:28)
最新发布
10-29
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值