elasticSearch使用RestHighLevel批量提交数据

最新推荐文章于 2023-01-06 11:45:17 发布

半仙code

最新推荐文章于 2023-01-06 11:45:17 发布

阅读量3.4k

点赞数

CC 4.0 BY-SA版权

分类专栏： ElasticSearch

本文链接：https://blog.youkuaiyun.com/liz9411/article/details/99713306

ElasticSearch 专栏收录该内容

3 篇文章

订阅专栏

本文介绍了一种使用Java和ElasticSearch REST API批量导入大量数据到ElasticSearch索引的方法。通过读取本地文件，解析CSV数据，并利用批量请求减少网络往返次数，提高数据导入效率。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

elasticSearch基于restAPI批量提交数据

public void openfile() {
		String filepath="D:\\DATA\\city_id=341800\\001033_0";
		String encoding ="UTF-8";
		RestHighLevelClient restClient=new RestHighLevelClient(RestClient.builder(new HttpHost("192.168.30.128",9200,"http")));
		File files =new File(filepath);
		try {
			InputStreamReader read = new InputStreamReader(new FileInputStream(files),encoding);
			BufferedReader bufferedReader = new BufferedReader(read);
			String lineTxt = null;
            try {
            	int i=1;
            	BulkRequest request = new BulkRequest();
            	BulkResponse bulkResponse;
				while((lineTxt = bufferedReader.readLine()) != null){
					String[]  strs=lineTxt.split(",");
					//System.out.println(strs.length);
					request.add(new IndexRequest("test-index", "test", ""+i+"").source(XContentType.JSON,"1", strs[0],
							"2",checkNull(strs[1]),
							"3",checkNull(strs[3]),
							"4",checkNull(strs[4]),
							"5",checkNull(strs[5]),
							....
							"67",checkNull(strs[58])));
					if(i%1000==0) {
						System.out.println(i);
						restClient.bulk(request);
					}
					i++;
				}
				restClient.bulk(request);
			} catch (IOException e) {
				e.printStackTrace();
			}
		} catch (UnsupportedEncodingException | FileNotFoundException e1) {
			e1.printStackTrace();
		}
	}