
ES
非ban必选
黑,真他妈的黑
展开
-
ES可视化管理工具
ElasticHDGitHub - qax-os/ElasticHD: Elasticsearch 可视化DashBoard, 支持Es监控、实时搜索,Index template快捷替换修改,索引列表信息查看, SQL converts to DSL等https://github.com/qax-os/ElasticHD/releases/tag/1.4.\ElasticHD.exe -p 127.0.0.1:9800...原创 2021-12-09 16:19:31 · 1175 阅读 · 0 评论 -
ES sql查询Java Low Level REST Client
@AutowiredRestHighLevelClient restHighLevelClient;通过高级API获取restHighLevelClient.getLowLevelClient(); String method = "GET"; String endPoint = "/_sql"; Request request = new Request(method, endPoint); request.addPara.原创 2021-11-30 14:37:29 · 2055 阅读 · 0 评论 -
ES安装sql插件
GitHub - NLPchina/elasticsearch-sql: Use SQL to query ElasticsearchSince 7.5.0.0, the path/_sqlis changed to/_nlpcn/sql, and the path/_sql/_explainis changed to/_nlpcn/sql/explain.ES版本7.12.0.0./bin/elasticsearch-plugin install https://github...原创 2021-11-30 13:28:57 · 1446 阅读 · 0 评论 -
ES之RestHighLevelClient
package com.luding.diankan.es.utils;import org.apache.http.HttpHost;import org.apache.http.client.config.RequestConfig;import org.elasticsearch.action.search.SearchRequest;import org.elasticsearch.client.RestClient;import org.elasticsearch.client.Re.原创 2021-11-16 19:14:30 · 1462 阅读 · 0 评论 -
ES索引操作
索引名sourcedata,查看索引结构http://192.168.5.186:9200/sourcedata/_mapping?prettyES 7.x 索引名称必须都是小写原创 2021-10-15 15:42:16 · 102 阅读 · 0 评论 -
ES集群数据迁移工具
https://github.com/medcl/esmcopy indexindex_namefrom192.168.1.xto192.168.1.y:9200./bin/esm -s http://192.168.1.x:9200 -d http://192.168.1.y:9200 -x index_name -w=5 -b=10 -c 10000copy indexsrc_indexfrom192.168.1.xto192.168.1.y:9200a...原创 2021-10-13 11:21:30 · 673 阅读 · 0 评论 -
ES集群安装
暂时记录,后期有时间整理集群各节点安装javaJAVA_HOME=/usr/local/jdk1.8.0_181CLASSPATH=.:$JAVA_HOME/jre/lib/ext:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jarPATH=$JAVA_HOME/bin:$HOME/bin:$HOME/.local/bin:$PATH2、集群各节点系统配置修改echo '* soft nofile 65536' >> /etc/s原创 2021-10-11 10:31:20 · 117 阅读 · 0 评论 -
springboot连接es集群
代码:es集群没有像类似redis集群那样需要修改很多东西,es集群比单节点多的仅仅是在spring.data.elasticsearch.cluster-nodes后多加几个连接:server.port=7777server.servlet.path =/es# elasticsearch集群名称,默认的是elasticsearchspring.data.elasticsearch.cluster-name=wtyy-es#节点的地址 注意api模式下端口号是9300,千万不要写成9200原创 2021-09-04 15:42:11 · 2985 阅读 · 0 评论 -
ES 大数据量速度优化
(1)性能优化的杀手锏——filesystem cache (即 os cache,操作系统的缓存)es的搜索引擎严重依赖于底层的filesystem cache,你如果给filesystem cache更多的内存,尽量让内存可以容纳所有的indx segment file索引数据文件,那么你搜索的时候就基本都是走内存的,性能会非常高。比如说,你一共要在es中存储1T的数据,那么你的多台机器留个filesystem cache的内存加起来综合,至少要到512G,至少半数的情况下,...原创 2021-08-31 13:57:53 · 1618 阅读 · 0 评论 -
ES过滤聚合
"aggs" : { "<aggregation_name>" : { <!--聚合的名字 --> "<aggregation_type>" : { <!--聚合的类型 --> <aggregation_body> <!--聚合体:对哪些字段进行聚合 --> } [,"meta" : { [<meta_data_body>] } ]? <.原创 2021-08-12 16:49:25 · 690 阅读 · 0 评论 -
java修复损坏zip文件提取文件
package com.pojo.common.core.utils;import cn.hutool.core.util.ZipUtil;import lombok.SneakyThrows;import org.apache.ibatis.logging.Log;import org.apache.ibatis.logging.LogFactory;import java.io.BufferedOutputStream;import java.io.File;import java..原创 2021-08-07 18:13:03 · 643 阅读 · 0 评论 -
ES查询总数
{ "track_total_hits":true, "query": { "bool": { "must": [ { "term": { "rtype.keyword": "010100" } }, { "prefix": { "incharge_wa_department.keyword": "34" .原创 2021-08-07 14:57:51 · 4139 阅读 · 0 评论 -
SpringdataES复杂查询和统计
@GetMapping("/or") public Object or() { String urlAgg = "police_situation_no"; String urlType = "010100"; Script exist = new Script("doc['" + urlAgg + ".keyword'].size()>0"); BoolQueryBuilder booleanQuery = QueryBu...原创 2021-08-07 10:28:04 · 693 阅读 · 0 评论 -
es 脚本及脚本查询
{ "query": { "bool": { "must": [ { "term": { "rtype.keyword": "820100" } }, { "script": { "script": { "lang": "painless", "source": "doc[.原创 2021-08-04 13:50:07 · 1795 阅读 · 0 评论 -
ES多字段组合查询
{ "query": { "bool": { "must": [ { "term": { "rtype.keyword": "020200" } } ] } }, "size": 0, "aggs": { "app": { "terms": { "script": "doc['contact_account_ty...原创 2021-08-03 19:48:05 · 3452 阅读 · 0 评论 -
ES查询entity content is too long [114829448] for the configured buffer limit [104857600]; nested excep
解决方案工程添加类package com.luding.task.config;import org.apache.http.HttpResponse;import org.apache.http.nio.protocol.HttpAsyncResponseConsumer;import org.elasticsearch.client.HeapBufferedAsyncResponseConsumer;import org.elasticsearch.client.HttpAsyncR原创 2021-07-28 22:29:07 · 2636 阅读 · 0 评论 -
ES分词插件
https://github.com/medcl/elasticsearch-analysis-ik后期维护原创 2021-07-13 13:38:20 · 238 阅读 · 0 评论