es学习笔记

最新推荐文章于 2025-03-24 19:00:00 发布

狂砍大佬黑

最新推荐文章于 2025-03-24 19:00:00 发布

阅读量1.6k

点赞数 3

分类专栏： springboot 文章标签： elasticsearch

本文链接：https://blog.youkuaiyun.com/weixin_43818323/article/details/113754289

版权

springboot 专栏收录该内容

1 篇文章

订阅专栏

临近过年,小弟我上班闲来无事,左翻翻又看看,甚是无聊,思来想去还是b站有意思.每天给我推荐学习资料,沉迷学习,难以自拔,光看不不练吧,假把式,故记下笔记一篇.希望和大家携手共进,学习java,从入门到入土…

一 docker安装es,kibana,ik

拉取es镜像

docker pull elasticsearch:7.4.2

拉取kibana镜像:可视化数据检索

docker pull kibana:7.4.2

创建es容器

mkdir -p /home/mrmei/mydata/elasticsearch/config  //创建需要挂载外部配置文件的目录
mkdir -p /home/mrmei/mydata/elasticsearch/data //创建需要挂载外部数据文件的目录
mkdir -p /home/mrmei/mydata/elasticsearch/data //创建插件挂载目录
//配置文件配置跨域
echo "http.host: 0.0.0.0" >> /mydata/elasticsearch/config/elasticsearch.yml
chmod -R 777 /mydata/elasticsearch/ //保证目录权限
//创建并运行容器
docker run --name elasticsearch -p 9200:9200 -p 9300:9300 \
-e "discovery.type=single-node" \
-e ES_JAVA_OPTS="-Xms64m -Xmx512m" \
-v /home/mrmei/mydata/elasticsearch/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
-v /home/mrmei/mydata/elasticsearch/data:/usr/share/elasticsearch/data \
-v /home/mrmei/mydata/elasticsearch/plugins:/usr/share/elasticsearch/plugins \
-d elasticsearch:7.4.2

创建kibana容器

docker run --name kibana -e ELASTICSEARCH_HOSTS=http://192.168.217.128:9200 -p 5601:5601 -d kibana:7.4.2 //ip地址修改为虚拟机地址

kibana图形化界面访问地址

http://192.168.217.128:5601/

ki分词器

https://github.com/medcl/elasticsearch-analysis-ik/releases 选择es对应版本的ik分词器

//直接在外部挂载的plugins目录下安装ik分词器
//安装wget
yum -y install wget
//拉取ki分词器
//进入plugins目录
wget https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.4.2/elasticsearch-analysis-ik-7.4.2.zip
//安装unzip
unzip elasticsearch-analysis-ik-7.4.2.zip
//删除压缩包
rm -r *.zip

自定义词库

修改/usr/share/elasticsearch/plugins/ik/config/中的 IKAnalyzer.cfg.xml

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
<properties> <comment>IK Analyzer 扩展配置</comment>
    <!--用户可以在这里配置自己的扩展字典 --> 
    <entry key="ext_dict"></entry> 
    <!--用户可以在这里配置自己的扩展停止词字典--> 
    <entry key="ext_stopwords"></entry> <!--用户可以在这里配置远程扩展字典 -->
    <entry key="remote_ext_dict">http://192.168.128.130/fenci/myword.txt</entry>
    <!--用户可以在这里配置远程扩展停止词字典--> 
    <!-- <entry key="remote_ext_stopwords">words_location</entry> -->
</properties>

二检索

官方文档地址:https://www.elastic.co/guide/index.html
在这里插入图片描述

在这里插入图片描述

1 Elasticsearch-rest-client

9300:tcp
9200:http
- JestClient:非官方,更新比较慢
- RestTemplate:模拟发送请求,需要自己封装请求,比较麻烦
- HttpClient:同上
- Elasticsearche-Rest-Client:官方RestClient,封装ES操作上手简单

https://www.elastic.co/guide/en/elasticsearch/client/java-rest
在这里插入图片描述

2 SpringBoot整合es

导入依赖(版本与es保持一致)

<dependency>
    <groupId>org.elasticsearch.client</groupId>
    <artifactId>elasticsearch-rest-high-level-client</artifactId>
    <version>7.4.2</version>
</dependency>

在这里插入图片描述
出现了6.4.3版本的依赖,springboot默认集成的高级客户端的版本

[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-elkfBiIR-1612755150786)(C:\Users\pc\AppData\Roaming\Typora\typora-user-images\image-20210206143926404.png)]
在这里插入图片描述
在pom文件的properties中配置版本

<properties>
    <java.version>1.8</java.version>
    <elasticsearch.version>7.4.2</elasticsearch.version>
</properties>

注入配置类

@Configuration
public class ElasticSearchConfig {
    @Bean
    public RestHighLevelClient esRestClient(){
        RestClientBuilder builder = RestClient.builder(
                new HttpHost("192.168.217.128", 9200, "http")
        );
        return new RestHighLevelClient(builder);
    }
}

3 client检索测试

请求设置项RequestOptions https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-low-usage-requests.html#java-rest-low-usage-request-options
在这里插入图片描述

private static final RequestOptions COMMON_OPTIONS;
static {
    RequestOptions.Builder builder = RequestOptions.DEFAULT.toBuilder();
    builder.addHeader("Authorization", "Bearer " + TOKEN); 
    builder.setHttpAsyncResponseConsumerFactory(           
        new HttpAsyncResponseConsumerFactory
            .HeapBufferedResponseConsumerFactory(30 * 1024 * 1024 * 1024));
    COMMON_OPTIONS = builder.build();
}

测试存储/更新数据

/**
* 测试存储数据到es
* 更新也ok
*/
@Test
public void test() throws IOException {
    //创建索引的请求
    IndexRequest indexRequest = new IndexRequest("users");
    //数据的id
    indexRequest.id("1");
    //json字符串
    User user = new User("张三", "123456", 18);
    Object str = JSON.toJSON(user);
    //要保存的信息
    indexRequest.source(str, XContentType.JSON);
    //发送请求
    IndexResponse res = client.index(indexRequest, ElasticSearchConfig.COMMON_OPTIONS);
    log.info(res.toString());
}

GET /users/_search

检索 https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-high-search.html

/**
     * 测试搜索
     */
    @Test
    public void testSearch() throws IOException {
        //创建检索请求
        SearchRequest request = new SearchRequest();
        request.indices("users");
        //构建检索条件
        //SearchSourceBuilder 封装条件
        SearchSourceBuilder builder = new SearchSourceBuilder();
        /*builder.query(); 查询条件
        builder.from(); 分页
        builder.size();
        builder.aggregation(); 聚合
        */
        builder.query(QueryBuilders.matchQuery("name","zhangsan"));
        builder.aggregation(AggregationBuilders.sum("sumAge").field("age"));
        request.source(builder);
        //执行检索
        SearchResponse response = client.search(request, ElasticSearchConfig.COMMON_OPTIONS);
        //获取返回的结果
        System.out.println(response);
        //获取所有命中的记录 最外成hits
        SearchHits hits = response.getHits();
        //里层hits
        SearchHit[] hits1 = hits.getHits();
        for(SearchHit hit :hits){
            User user = JSONUtil.toBean(hit.getSourceAsString(), User.class);
        }
        //获取聚合信息
        Aggregations aggregations = response.getAggregations();
        Terms sumAge = aggregations.get("sumAge");
    }