flink1.16+连接Elasticsearch7官方例子报错解决方案

原创

于 2024-11-23 18:47:23 发布 · 1k 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#flink #es7 #java

flink输出至es，连接es7时使用的sink类是Elasticsearch7SinkBuilder，与es6链接方式不同，官网地址：fink连接es官方地址。

flink连接es7官方示例

依赖jar：

<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-elasticsearch7</artifactId>
    <version>3.0.1-1.16</version>
</dependency>

官方连接es7代码

import org.apache.flink.api.common.functions.MapFunction;
import org.apache.flink.connector.elasticsearch.sink.Elasticsearch7SinkBuilder;
import org.apache.flink.streaming.api.datastream.DataStream;

import org.apache.http.HttpHost;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.client.Requests;

import java.util.HashMap;
import java.util.Map;

DataStream<String> input = ...;

input.sinkTo(
    new Elasticsearch7SinkBuilder<String>()
        .setBulkFlushMaxActions(1) // Instructs the sink to emit after every element, otherwise they would be buffered
        .setHosts(new HttpHost("127.0.0.1", 9200, "http"))
        .