logstash安装教程linux版

logstash介绍

• 数据收集处理引擎
• ETL工具

安装步骤：

1.将logstash解压

进入logstash-6.8.3

cd logstash-6.8.3

2.新建一个文件夹用来存放数据库连接的配置文件

mkdir my-config

从这个连接获取配置文件：https://pan.baidu.com/s/1TtKRW-OmpQAKJthrZoeTww
提取码：3mwp

然后将其上传到刚才新建的文件夹下

编辑sqlserver-es.conf

vi sqlserver-es.conf

下面是监听数据库的字段变化配置，根据自己的需求配置即可

 

然后保存

启动es数据库

执行下面代码，在es数据库中创建模板

curl -H "Content-Type: application/json" -XPUT http://192.168.1.10中:9200/_template/consumer_statistics -d '
{"template":"consumer_statistics","order":2,"version":60001,"index_patterns":["consumer_statistics"],"settings":{"index":{"refresh_interval":"5s","max_result_window":"2147483647"}},"mappings":{"_default_":{"dynamic_templates":[{"message_field":{"path_match":"message","mapping":{"norms":false,"type":"text"},"match_mapping_type":"string"}},{"string_fields":{"mapping":{"norms":false,"type":"text","fields":{"keyword":{"ignore_above":1024,"type":"keyword"}}},"match_mapping_type":"string","match":"*"}}],"properties":{"@timestamp":{"type":"date"},"geoip":{"dynamic":true,"properties":{"ip":{"type":"ip"},"latitude":{"type":"half_float"},"location":{"type":"geo_point"},"longitude":{"type":"half_float"}}},"@version":{"type":"keyword"}}}},"aliases":{}}'

通过浏览器访问到es数据库，说明启动成功了

 

然后进入到进入logstash下的bin目录

启动

./logstash -f ../my-config/sqlserver-es.conf

如下就是启动成功了，并且每5秒更新一次数据