<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[join_null的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/join_null</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; join_null]]></copyright><item><title><![CDATA[ESP32-WROOM-32 ESP32 wifi模块基本参数与引脚定义]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/127900007</link><guid>https://blog.youkuaiyun.com/join_null/article/details/127900007</guid><author>join_null</author><pubDate>Thu, 17 Nov 2022 11:06:07 +0800</pubDate><description><![CDATA[esp32 woom 引脚序号与引脚名称对应关系]]></description><category></category></item><item><title><![CDATA[hadoop 透明加密先关命令]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/123377761</link><guid>https://blog.youkuaiyun.com/join_null/article/details/123377761</guid><author>join_null</author><pubDate>Wed, 09 Mar 2022 14:54:28 +0800</pubDate><description><![CDATA[HDFS 透明加密使用、Keystore和Hadoop KMS、加密区域、透明加密关键概念和架构、KMS配置
]]></description><category></category></item><item><title><![CDATA[flink 自定义周期水印，解决最后一个窗口因为缺少数据到达，不触发问题]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/123139056</link><guid>https://blog.youkuaiyun.com/join_null/article/details/123139056</guid><author>join_null</author><pubDate>Fri, 25 Feb 2022 18:47:14 +0800</pubDate><description><![CDATA[1.自定义周期水印


public class MyWaterMark implements AssignerWithPeriodicWatermarks&lt;MyEvent&gt; {

    private final long maxTimeLag = 3000; // 3 seconds

    @Override
    public long extractTimestamp(MyEvent element, long previousElementTimestamp) {
      ]]></description><category></category></item><item><title><![CDATA[cvat标注工具docker容器启动]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/122497164</link><guid>https://blog.youkuaiyun.com/join_null/article/details/122497164</guid><author>join_null</author><pubDate>Fri, 14 Jan 2022 19:05:03 +0800</pubDate><description><![CDATA[1.安装postgresql，Windows 上安装 PostgreSQL | 菜鸟教程

用上面安装好的pdadmin，创建一个mypgsql用户，授予所有权限



然后创建一个cvat数据库，并将owner指定为mypgsql用户



2.安装redis

3.拉取镜像，并启动容器

 拉取镜像


docker pull openvino/cvat_server:latest

 启动容器（注意挂载到主机上的目录/data/cvat_data_dir，要给予777权限，否则容器内应...]]></description><category></category></item><item><title><![CDATA[opencv学习]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/121908187</link><guid>https://blog.youkuaiyun.com/join_null/article/details/121908187</guid><author>join_null</author><pubDate>Tue, 14 Dec 2021 14:35:29 +0800</pubDate><description><![CDATA[1.opencv读取的摄像头数据是BGR排列的
如果发现，读取摄像头后的图像蓝色为棕色，将图像转为RGB即可


Imgproc.cvtColor(mat, mat, Imgproc.COLOR_BGR2RGB);


]]></description><category></category></item><item><title><![CDATA[doris常用命令]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/121531844</link><guid>https://blog.youkuaiyun.com/join_null/article/details/121531844</guid><author>join_null</author><pubDate>Thu, 25 Nov 2021 10:31:26 +0800</pubDate><description><![CDATA[1.基本维护命令


1.查看前端节点
SHOW PROC '/frontends'
2.查看后端节点
SHOW PROC '/backends'
3.查看表数据大小
SHOW DATA  # 查看所有表大小
SHOW DATA FROM org_project_data_2 # 查看指定表大小
5.查看表分区
SHOW PARTITIONS FROM new_table_name
6.查看load数据的lable的任务执行情况
SHOW LOAD WHERE label="my_label1"
7.重命名]]></description><category></category></item><item><title><![CDATA[自定义flink触发器注意事项]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/120534942</link><guid>https://blog.youkuaiyun.com/join_null/article/details/120534942</guid><author>join_null</author><pubDate>Tue, 28 Sep 2021 19:08:46 +0800</pubDate><description><![CDATA[1.几个重要方法

onElement方法 ，每有一个元素过来都会被调用

onProcessTime 方法，只要有一个元素过来，等到窗口最大滚动时间到，就会自动调用

onEventTime 方法，必须在onElement方法中，在有元素到来时，通过context的


ctx.registerEventTimeTimer(window.maxTimestamp());方法注册一个以当前窗口最大时间戳为时间的定时器（注册定时可以参看flink的默认触发器EventTimeTrigger类）。并且还要水印时]]></description><category></category></item><item><title><![CDATA[Springsecurity普通登录认证和OAuth2产生token的认证流程]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/119563095</link><guid>https://blog.youkuaiyun.com/join_null/article/details/119563095</guid><author>join_null</author><pubDate>Tue, 10 Aug 2021 11:37:32 +0800</pubDate><description><![CDATA[一、普通登录认证过程

    1.用户发起登录请求，请求登录接口/login（springsecurity默认登录接口地址）
    2.过滤器UsernamePasswordAuthenticationFilter验证当前请求是否是在请求登录接口/login,如果是调用attemptAuthentication方法开始认证
    3.attemptAuthentication方法在请求中获取到username、password参数封装成一个Authentication对象，调用...]]></description><category></category></item><item><title><![CDATA[Spark on yarn时，yarn-client、yarn-cluster、client、cluster用法]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/119543620</link><guid>https://blog.youkuaiyun.com/join_null/article/details/119543620</guid><author>join_null</author><pubDate>Mon, 09 Aug 2021 17:55:15 +0800</pubDate><description><![CDATA[1.yarn-client、cluster用法：


spark-submit \
--master yarn-cluster \

上面的写法等价于


spark-submit \
--master yarn \
--deploy-mode cluster \

2.yarn-client、client用法


spark-submit \
--master yarn-client \

等价于


spark-submit \
--master yarn \
--deploy-mode client.]]></description><category></category></item><item><title><![CDATA[requestMatchers()方法与authorizeRequests()区别，ResourceServerConfigurerAdapter与WebSecurityConfigurerAdapt]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/119390280</link><guid>https://blog.youkuaiyun.com/join_null/article/details/119390280</guid><author>join_null</author><pubDate>Mon, 09 Aug 2021 14:42:53 +0800</pubDate><description><![CDATA[一、requestMatchers()方法与authorizeRequests()区别

    1.理解这两个方法的区别首先要知道springsecurity中，每声明一个adapter实例，就会产生一条过滤器链，一个请求过来要走哪个过滤器链就是由requestMatchers()方法配置的url决定的。请求匹配上requestMatchers()配置的过滤器链后，在进一步的详细控制则是authorizeRequests()决定的。例如：

    下面这个adapter只对/api1...]]></description><category></category></item><item><title><![CDATA[Pulsar基本特点]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/115625536</link><guid>https://blog.youkuaiyun.com/join_null/article/details/115625536</guid><author>join_null</author><pubDate>Mon, 12 Apr 2021 15:54:00 +0800</pubDate><description><![CDATA[https://zhuanlan.zhihu.com/p/91750897?from_voters_page=true
]]></description><category></category></item><item><title><![CDATA[解决spark on yarn模式时，在yarn的web界面上点击ApplicationMaster无法看到SparkWebUi界面]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/110004923</link><guid>https://blog.youkuaiyun.com/join_null/article/details/110004923</guid><author>join_null</author><pubDate>Mon, 23 Nov 2020 19:09:35 +0800</pubDate><description><![CDATA[1.需要在hadoop集群的所有节点yarn-site.xml中加入如下配置


  &lt;property&gt;
    &lt;name&gt;yarn.web-proxy.address&lt;/name&gt;
    &lt;value&gt;master01:8089&lt;/value&gt;
  &lt;/property&gt;

在指定的master01节点启动web-proxy服务：./sbin/yarn-daemon.sh start proxyserver

2.重启所有节点.]]></description><category></category></item><item><title><![CDATA[解决cdh hive 与apache hadoop 混装，导致的cdh hive 启动失败]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/109297405</link><guid>https://blog.youkuaiyun.com/join_null/article/details/109297405</guid><author>join_null</author><pubDate>Mon, 26 Oct 2020 20:01:50 +0800</pubDate><description><![CDATA[https://blog.youkuaiyun.com/ggwxk1990/article/details/77926944
]]></description><category></category></item><item><title><![CDATA[presto自定函数]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/109288911</link><guid>https://blog.youkuaiyun.com/join_null/article/details/109288911</guid><author>join_null</author><pubDate>Mon, 26 Oct 2020 14:16:57 +0800</pubDate><description><![CDATA[https://www.cnblogs.com/lrxvx/p/12558902.html
]]></description><category></category></item><item><title><![CDATA[logback配置]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/108833797</link><guid>https://blog.youkuaiyun.com/join_null/article/details/108833797</guid><author>join_null</author><pubDate>Sun, 27 Sep 2020 18:38:57 +0800</pubDate><description><![CDATA[1.配置


&lt;?xml version="1.0" encoding="UTF-8"?&gt;
&lt;configuration debug="false"&gt;
    &lt;!--定义日志文件的存储地址 勿在 LogBack 的配置中使用相对路径--&gt;
    &lt;property name="LOG_HOME" value="logs"/&gt;
    &lt;!-- 控制台输出 --&gt;
    &lt;appender name="STDOUT" class="ch.]]></description><category></category></item><item><title><![CDATA[influxdb 动态修改@Measurement注解]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/108493744</link><guid>https://blog.youkuaiyun.com/join_null/article/details/108493744</guid><author>join_null</author><pubDate>Wed, 09 Sep 2020 17:15:28 +0800</pubDate><description><![CDATA[https://segmentfault.com/a/1190000020681052?utm_source=tag-newest
]]></description><category></category></item><item><title><![CDATA[ES优化]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/108446318</link><guid>https://blog.youkuaiyun.com/join_null/article/details/108446318</guid><author>join_null</author><pubDate>Mon, 07 Sep 2020 13:37:47 +0800</pubDate><description><![CDATA[1.ES的堆栈内存默认1G，实际生产要调整，调整到实际内存的一半，可以通过配置环境变量ES_HEAP_SIZE调整。

参考：https://www.cnblogs.com/xingxiz/p/10267036.html

es常用状态查看命令：https://blog.youkuaiyun.com/u014017121/article/details/70312784

2.增加bulk 操作效率

threadpool.index.queue_size: 1000
indices.memory.index_buff]]></description><category></category></item><item><title><![CDATA[hive内部表和外部表，增加分区并加载数据区别]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/108264010</link><guid>https://blog.youkuaiyun.com/join_null/article/details/108264010</guid><author>join_null</author><pubDate>Thu, 27 Aug 2020 16:43:35 +0800</pubDate><description><![CDATA[假定有hive中有两个表empl_inn(内部表)和empl_ext(外部表),他们都有分区（logdate string）；
1.对于外部表 empl_ext
alter table empl_ext add partition (logdate=‘2015-02-26’) location ‘hdfs://nameservice1/vod_pb/’; 执行添加分区时 vod_pb/ 文件夹下的数据不会被移动。并且没有分区目录logdate=2015-02-26
alter table empl_ext ]]></description><category></category></item><item><title><![CDATA[influxdb安装]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/108240228</link><guid>https://blog.youkuaiyun.com/join_null/article/details/108240228</guid><author>join_null</author><pubDate>Wed, 26 Aug 2020 15:07:55 +0800</pubDate><description><![CDATA[https://www.cnblogs.com/mafeng/p/6848166.html
]]></description><category></category></item><item><title><![CDATA[ES 批量Bulk操作存储数据到ES数据丢失解决]]></title><link>https://blog.youkuaiyun.com/join_null/article/details/107556236</link><guid>https://blog.youkuaiyun.com/join_null/article/details/107556236</guid><author>join_null</author><pubDate>Fri, 24 Jul 2020 11:01:48 +0800</pubDate><description><![CDATA[private static void output(SearchHit[] hits) {
            BulkRequestBuilder prepareBulk = writeClient.prepareBulk();
            for (SearchHit sh : hits) {
                prepareBulk.add(writeClient
                        .prepareIndex(writeI...]]></description><category></category></item></channel></rss>