ELK基础环境搭建-elasticsearch安装

最新推荐文章于 2024-07-26 11:20:32 发布

原创最新推荐文章于 2024-07-26 11:20:32 发布 · 455 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#elasticsearch

开源方案专栏收录该内容

8 篇文章

订阅专栏

本文详细介绍了一种常见的日志处理方案——ELK堆栈的部署过程，包括Elasticsearch、Logstash和Kibana的配置步骤。部署过程中涵盖了系统参数调整、Java环境安装、Elasticsearch参数设置及启动验证等关键环节。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

本测试采用三台服务器，分别部署elasticsearch、logstash、kibana，相关环境说明如下：

主机名	IP	用途	OS版本	软件版本
es1	192.168.2.11	elasticsearch	CentOS 7.2.1511	2.4.1
logstash	192.168.2.21	logstash	CentOS 7.2.1511	2.4.0
kibana	192.168.2.31	kibana	CentOS 7.2.1511	4.6.1

1 ElasticSearch部署

1.1 修改系统参数

1. hosts文件

vi /etc/hosts

127.0.0.1 localhost

192.168.2.11 es1

2. limits及pam添加以下内容

vi /etc/security/limits.conf

* soft nofile 1024

* hard nofile 65536

* soft nproc 2047

* hard nproc 16384

* soft stack 10240

* hard stack 32768

vi /etc/pam.d/login

session required/lib64/security/pam_limits.so

1.2 安装java

rpm -ivh jdk-8u101-linux-x64.rpm

vi /etc/profile

export JAVA_HOME=/usr/java/jdk1.8.0_101

export PATH=$JAVA_HOME/bin:$PATH

1.3 安装elasticsearch

1. 解压

tar -xvzf elasticsearch-2.4.1.tar.gz

如果出现以下报错，那么可能是下载的包有问题，建议重新下载：

gzip: stdin: unexpected end offile

tar: Unexpected EOF in archive

tar: Error is not recoverable:exiting now

2. 修改参数文件

vi /home/cendish/software/elasticsearch-2.4.1/config/elasticsearch.yml

cluster.name: cds-cluster

node.name: es-1

network.host: 192.168.2.11

3. 启动进程

./elasticsearch -d

[cendish@es1 logs]$ morecds-cluster.log

[2016-10-09 10:12:41,156][INFO][node ] [es-1]version[2.4.1

], pid[5792],build[c67dc32/2016-09-27T18:57:55Z]

[2016-10-09 10:12:41,158][INFO][node ] [es-1]initializing

...

[2016-10-09 10:12:42,076][INFO][plugins ] [es-1]modules [rein

dex, lang-expression,lang-groovy], plugins [], sites []

[2016-10-09 10:12:42,111][INFO][env ] [es-1] using[1] dat

a paths, mounts [[/ (rootfs)]],net usable_space [13.5gb], net total_space [17.4

gb], spins? [unknown], types[rootfs]

[2016-10-09 10:12:42,111][INFO][env ] [es-1] heapsize [99

0.7mb], compressed ordinaryobject pointers [true]

[2016-10-09 10:12:45,878][INFO][node ] [es-1]initialized

[2016-10-09 10:12:45,878][INFO][node ] [es-1]starting ...

[2016-10-09 10:12:46,038][INFO][transport ] [es-1]publish_addre

ss {192.168.2.11:9300},bound_addresses {192.168.2.11:9300}

[2016-10-09 10:12:46,052][INFO][discovery ] [es-1] cds-cluster/f

6CSAO1OS0mdb5PTUS_hYg

[2016-10-09 10:12:49,244][INFO][cluster.service ] [es-1]new_master {e

s-1}{f6CSAO1OS0mdb5PTUS_hYg}{192.168.2.11}{192.168.2.11:9300},reason: zen-disco

-join(elected_as_master, [0]joins received)

[2016-10-09 10:12:49,278][INFO][http ] [es-1]publish_addre

ss {192.168.2.11:9200},bound_addresses {192.168.2.11:9200}

[2016-10-09 10:12:49,279][INFO][node ] [es-1]started

[2016-10-09 10:12:49,327][INFO][gateway ] [es-1] recovered [0]

indices into cluster_state

[2016-10-09 10:13:19,786][INFO][node ] [es-1]stopping ...

[2016-10-09 10:13:19,899][INFO][node ] [es-1]stopped

[2016-10-09 10:13:19,899][INFO][node ] [es-1]closing ...

[2016-10-09 10:13:19,908][INFO][node ] [es-1]closed

[2016-10-09 10:13:42,865][INFO][node ] [es-1]version[2.4.1

], pid[5921],build[c67dc32/2016-09-27T18:57:55Z]

[2016-10-09 10:13:42,866][INFO][node ] [es-1]initializing

...

[2016-10-09 10:13:43,959][INFO][plugins ] [es-1]modules [rein

dex, lang-expression,lang-groovy], plugins [], sites []

[2016-10-09 10:13:43,991][INFO][env ] [es-1] using [1] dat

a paths, mounts [[/ (rootfs)]],net usable_space [13.5gb], net total_space [17.4

gb], spins? [unknown], types[rootfs]

[2016-10-09 10:13:43,991][INFO][env ] [es-1] heapsize [99

0.7mb], compressed ordinaryobject pointers [true]

[2016-10-09 10:13:47,664][INFO][node ] [es-1]initialized

[2016-10-09 10:13:47,664][INFO][node ] [es-1]starting ...

[2016-10-09 10:13:47,817][INFO][transport ] [es-1]publish_addre

ss {192.168.2.11:9300},bound_addresses {192.168.2.11:9300}

[2016-10-09 10:13:47,831][INFO][discovery ] [es-1]cds-cluster/m

43sow0PRsSmLE1mBaHjdg

[2016-10-09 10:13:50,944][INFO][cluster.service ] [es-1] new_master{e

s-1}{m43sow0PRsSmLE1mBaHjdg}{192.168.2.11}{192.168.2.11:9300},reason: zen-disco

-join(elected_as_master, [0]joins received)

[2016-10-09 10:13:50,997][INFO][http ] [es-1]publish_addre

ss {192.168.2.11:9200},bound_addresses {192.168.2.11:9200}

[2016-10-09 10:13:50,998][INFO][node ] [es-1]started

[2016-10-09 10:13:51,033][INFO][gateway ] [es-1]recovered [0]

indices into cluster_state

[cendish@es1 logs]$

4. 测试

http://192.168.2.11:9200/