fluentd filter插件（v0.12)

最新推荐文章于 2024-09-02 09:49:31 发布

转载最新推荐文章于 2024-09-02 09:49:31 发布 · 5k 阅读

文章标签：

#日志

日志系统专栏收录该内容

36 篇文章

订阅专栏

本文介绍了Fluentd的过滤插件功能，包括如何使用过滤插件修改事件流，例如通过过滤、丰富或删除字段来满足特定需求。文中还列举了常用的过滤插件类型。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

https://docs.fluentd.org/v0.12/articles/filter-plugin-overview

Fluentd has 6 types of plugins: Input, Parser, Filter, Output, Formatter and Buffer. This article gives an overview of Filter Plugin.

Overview

Filter plugins enables Fluentd to modify event streams. Example use cases are:

Filtering out events by grepping the value of one or more fields.
Enriching events by adding new fields.
Deleting or masking certain fields for privacy and compliance.

How to Use

It is used with the <filter> directive as follows:

<filter foo.bar>
  @type grep
  regexp1 message cool
</filter>

The above directive matches events with the tag “foo.bar”, and if the “message” field’s value contains “cool”, the events go through the rest of the configuration.

Like the <match> directive for output plugins, <filter> matches against a tag. Once the event is processed by the filter, the event proceeds through the configuration top-down. Hence, if there are multiple filters for the same tag, they are applied in descending order. Hence, in the following example,

<filter foo.bar>
  @type grep
  regexp1 message cool
</filter>

<filter foo.bar>
  @type record_transformer
  <record>
    hostname "#{Socket.gethostname}"
  </record>
</filter>

Only the events whose “message” field contain “cool” get the new field “hostname” with the machine’s hostname as its value.

Users can create their own custom plugins with a bit of Ruby. See this section for more information.