logstash7.4. mysql数据导入es并指定自定义的逗号分词器

戴国进

于 2020-06-30 20:20:02 发布

阅读量9.2k

点赞数

分类专栏： logstash | filebeat | kibana

本文链接：https://blog.youkuaiyun.com/JineD/article/details/107049682

版权

logstash | filebeat | kibana 专栏收录该内容

17 篇文章

订阅专栏

本文详细介绍了如何创建并配置Logstash的template-es.json文件，以适配Elasticsearch的数据索引需求。通过设置特定的字段类型、分析器及时间刷新间隔，确保数据的高效处理与检索。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

参考了: https://blog.youkuaiyun.com/alan_liuyue/article/details/78361431

https://www.cnblogs.com/jstarseven/p/7707499.html

步骤一、新建文件 template-es.json (名字可自定义)，内容如下：

{
    "template": "*",
    "version": 50001,
    "settings": {
        "index.refresh_interval": "5s",
        "analysis": {
            "analyzer": {
                "comma": {
                     "type": "pattern",
                     "pattern":","
                }
            }
        }
    },
    "mappings": {
        "properties": {
            "id": {
                "type": "long"
            },
            "template_name": {
                "type": "text",
                "analyzer": "standard"
            },
            "template_data": {
                "type": "text",
                "analyzer": "standard"
            },
            "author": {
                "type": "text",
                "analyzer": "standard"
            },
            "keywords": {
                "type": "text",
                "analyzer": "comma"
            },
            "category_ids": {
                "type": "text",
                "analyzer": "comma"
            },
            "thumb_id": {
                "type": "long"
            },
            "description": {
                "type": "text",
                "analyzer": "standard"
            },
            "updated_at": {
                "type": "date"
            },
            "created_at": {
                "type": "date"
            },
            "@timestamp": {  
               "type": "date"
            },
            "@version": {
              "type": "keyword"
            }
        }
    }
}

步骤二、在logstash.conf配置如下：