分布式搜索Lily安装与配置

最新推荐文章于 2024-09-02 17:28:27 发布

原创最新推荐文章于 2024-09-02 17:28:27 发布 · 1.7k 阅读

2 ·

CC 4.0 BY-SA版权

Lily 专栏收录该内容

3 篇文章

订阅专栏

本文档详细介绍了如何安装和配置分布式搜索系统Lily，包括Hadoop、HBase、ZooKeeper的安装，HBase额外jar的部署，Hadoop中旧Avro jar的清理，Solr的安装，以及Lily连接HBase、Hadoop和ZooKeeper的配置，最后启动Lily服务器进程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

参考文档：

http://docs.ngdata.com/lily-docs-current/414-lily/432-lily.html

1.Installing Hadoop, HBase and ZooKeeper

此处省略几百字...

2.HBase: deploy extra jars

copy以下包到hbase lib下：

    lib/org/lilyproject/lily-hbase-ext/2.0/lily-hbase-ext-2.0.jar
    lib/org/lilyproject/lily-bytes/2.0/lily-bytes-2.0.jar
    lib/org/lilyproject/lily-util/2.0/lily-util-2.0.jar
    lib/org/lilyproject/lily-repository-api/2.0/lily-repository-api-2.0.jar
    lib/org/lilyproject/lily-repository-id-impl/2.0/lily-repository-id-impl-2.0.jar
    lib/org/lilyproject/lily-hbaseindex-base/2.0/lily-hbaseindex-base-2.0.jar
    lib/com/gotometrics/orderly/orderly/0.11/orderly-0.11.jar
    lib/org/lilyproject/lily-indexer-derefmap-indexfilter/2.0/lily-indexer-derefmap-indexfilter-2.0.jar

3.Hadoop: cleanup old Avro jars

$find /usr/lib/hadoop* -name "avro*jar" -exec rm {} \;

4.Installing Solr

下载solr.4.1版本，解压后找到solr/example/目录，使用如下命令启动solr：

$java -jar start.jar
...
INFO: Loading spell index for spellchecker: default
Feb 4, 2013 5:48:54 PM org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener newSearcher
INFO: Loading spell index for spellchecker: wordbreak
Feb 4, 2013 5:48:54 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [collection1] Registered new searcher Searcher@6839ea58 main{StandardDirectoryReader(segments_1:1)}
Feb 4, 2013 5:48:54 PM org.apache.solr.core.CoreContainer registerCore
INFO: registering core: collection1
Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: user.dir=/home/solr-4.1.0/example
Feb 4, 2013 5:48:54 PM org.apache.solr.servlet.SolrDispatchFilter init
INFO: SolrDispatchFilter.init() done
2013-02-04 17:48:54.651:INFO:oejs.AbstractConnector:Started SocketConnector@0.0.0.0:8983

solr安装验证：

5.Configuring Lily to connect to your HBase, Hadoop & ZooKeeper

Then adjust the following files:

    conf/general/hbase.xml
    conf/general/mapreduce.xml
    conf/general/zookeeper.xml
    conf/repository/repository.xml
    conf/rpc/rpc.xml

6.Running The Lily Server Process

$su hdfs
$bin/lily-server
[INFO ][10:21:21,192][main      ] org.kauriproject.runtime.info - Starting the Kauri Runtime.
[INFO ][10:21:21,470][main      ] org.kauriproject.runtime.info - Reading module configurations of 12 modules.
[INFO ][10:21:21,987][main      ] org.kauriproject.runtime.info - Starting the modules.
[INFO ][10:21:21,997][main      ] org.kauriproject.runtime.info - Starting module pluginregistry - /home/lily-2.0/lib/org/lilyproject/lily-pluginregistry-impl/2.0/lily-pluginregistry-impl-2.0.jar
[INFO ][10:21:22,590][main      ] org.kauriproject.runtime.info - Starting module general - /home/lily-2.0/lib/org/lilyproject/lily-general-module/2.0/lily-general-module-2.0.jar
[INFO ][10:21:24,621][main      ] org.kauriproject.runtime.info - Starting module rowlog - /home/lily-2.0/lib/org/lilyproject/lily-rowlog-module/2.0/lily-rowlog-module-2.0.jar
[INFO ][10:21:25,771][main      ] org.kauriproject.runtime.info - Starting module indexer-integration - /home/lily-2.0/lib/org/lilyproject/lily-indexer-integration-module/2.0/lily-indexer-integration-module-2.0.jar
[INFO ][10:21:25,928][main      ] org.kauriproject.runtime.info - Starting module repository - /home/lily-2.0/lib/org/lilyproject/lily-repository-module/2.0/lily-repository-module-2.0.jar
[INFO ][10:21:30,155][main      ] org.kauriproject.runtime.info - Starting module indexer - /home/lily-2.0/lib/org/lilyproject/lily-indexer-module/2.0/lily-indexer-module-2.0.jar
[INFO ][10:21:30,579][main      ] org.kauriproject.runtime.info - Starting module avro - /home/lily-2.0/lib/org/lilyproject/lily-rpc-module/2.0/lily-rpc-module-2.0.jar
[INFO ][10:21:31,018][main      ] org.kauriproject.runtime.info - Starting module template - /home/lily-2.0/lib/org/kauriproject/kauri-template-service-impl/0.4-r1966/kauri-template-service-impl-0.4-r1966.jar
[INFO ][10:21:31,660][main      ] org.kauriproject.runtime.info - Starting module representation - /home/lily-2.0/lib/org/kauriproject/kauri-representationbuilder-impl/0.4-r1966/kauri-representationbuilder-impl-0.4-r1966.jar
[INFO ][10:21:31,727][main      ] org.kauriproject.runtime.info - Starting module routing - /home/lily-2.0/lib/org/kauriproject/kauri-routing-impl/0.4-r1966/kauri-routing-impl-0.4-r1966.jar
[INFO ][10:21:31,783][main      ] org.kauriproject.runtime.info - Starting module rest - /home/lily-2.0/lib/org/lilyproject/lily-rest-module/2.0/lily-rest-module-2.0.jar
[INFO ][10:21:31,914][main      ] org.kauriproject.runtime.info - Starting module webui - /home/lily-2.0/lib/org/lilyproject/lily-webui-module/2.0/lily-webui-module-2.0.jar
[INFO ][10:21:31,956][main      ] org.kauriproject.runtime.info - Starting restservice public access.
[INFO ][10:21:32,133][main      ] org.kauriproject.runtime.info - Runtime initialisation finished.
[INFO ][10:21:32,135][main      ] org.kauriproject.runtime.info - Kauri Runtime started [February 5, 2013 10:21:32 AM CST]