<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[1.01^365]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/qq_38094271</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; qq_38094271]]></copyright><item><title><![CDATA[ds一些不易排查问题的总结]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/132016859</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/132016859</guid><author>qq_38094271</author><pubDate>Mon, 31 Jul 2023 10:14:55 +0800</pubDate><description><![CDATA[任务执行期间 自动把自己杀死了退出码137，且任务多是在worker 本地执行的任务（比如datax），137 无故退出要么是手动杀死，又或者是oom 了，这是因为datax 需要本地的资源执行， 当worker 并发量大的时候xmx和xms 不是一样的。导致任务资源膨胀起来之后oom 了。解决方案，减小worker 的并发量，或者将这些消耗本地资源的任务放到非worker 上执行。任务没有设置延迟，但是会显示延时执行，（集群时间不统一）]]></description><category></category></item><item><title><![CDATA[datax 打包本地debug 执行]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/132016684</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/132016684</guid><author>qq_38094271</author><pubDate>Mon, 31 Jul 2023 10:06:09 +0800</pubDate><description><![CDATA[我需要将/Users/trueland/Documents/soft/datax/plugin/reader/elasticseachreader 删除 将项目中 的esreader target/datax/elasticsearchreader 复制到/Users/trueland/Documents/soft/datax/plugin/reader 下即可。5.注意项，datax 运行加载的代码是datax home 下打包好的代码，不是datax 启动项目下的代码。1.全量 打包 datax。]]></description><category></category></item><item><title><![CDATA[c4d脚本(一)]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/129215419</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/129215419</guid><author>qq_38094271</author><pubDate>Sat, 25 Feb 2023 18:55:05 +0800</pubDate><description><![CDATA[对c4d 脚本的一些记录]]></description><category></category></item><item><title><![CDATA[dolphinscheduler 初始化任务队列 initTaskQueue]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126621239</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126621239</guid><author>qq_38094271</author><pubDate>Wed, 31 Aug 2022 15:11:28 +0800</pubDate><description><![CDATA[dolphinscheduler initTaskQueue]]></description><category></category></item><item><title><![CDATA[dolphinscheduler,DAG生成分析]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126567398</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126567398</guid><author>qq_38094271</author><pubDate>Sun, 28 Aug 2022 20:19:52 +0800</pubDate><description><![CDATA[DAG流程生成分析]]></description><category></category></item><item><title><![CDATA[hadoop主要组建简写笔记]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126567005</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126567005</guid><author>qq_38094271</author><pubDate>Sun, 28 Aug 2022 10:20:55 +0800</pubDate><description><![CDATA[hadoop 笔记]]></description><category></category></item><item><title><![CDATA[字节码加载过程]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126566967</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126566967</guid><author>qq_38094271</author><pubDate>Sun, 28 Aug 2022 10:18:46 +0800</pubDate><description><![CDATA[字节码加载过程]]></description><category></category></item><item><title><![CDATA[线程安全笔记]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126566905</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126566905</guid><author>qq_38094271</author><pubDate>Sun, 28 Aug 2022 10:13:18 +0800</pubDate><description><![CDATA[线程安全的笔记]]></description><category></category></item><item><title><![CDATA[datart 服务端聚合以及http 和 file 开启缓存过程]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/126429771</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/126429771</guid><author>qq_38094271</author><pubDate>Tue, 23 Aug 2022 17:48:16 +0800</pubDate><description><![CDATA[datart 服务端聚合以及http和file 开启缓存的过程]]></description><category></category></item><item><title><![CDATA[dolphinscheduler的ProcessDefinition流程分析]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/125946857</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/125946857</guid><author>qq_38094271</author><pubDate>Sat, 23 Jul 2022 15:44:16 +0800</pubDate><description><![CDATA[并行度/开始和结束之间总共次数选择最小值作为command的个数+依赖的schedules个数的command。使用CountDownLatch闭锁逻辑将所有commands转换成processInstance。生成自己本身/再生成依赖的schedules个数的command。根据StateEventType进行不同的处理。正常结束意味着执行到了endprocess。commandType==其他。processInstance入库。获取当前节点的commands。根据告警设置处理告警星弟。...]]></description><category></category></item><item><title><![CDATA[DataSphere Studio AppConn加载流程]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/124713049</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/124713049</guid><author>qq_38094271</author><pubDate>Sat, 23 Jul 2022 13:44:31 +0800</pubDate><description><![CDATA[AppConn加载流程
AppConnManager.getAppConnManager().listAppConns
#mermaid-svg-sKMSjdUTL9LfCbNZ {font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}#mermaid-svg-sKMSjdUTL9LfCbNZ .error-icon{fill:#552222;}#mermaid-svg-sKMSjdUTL9LfCbNZ .]]></description><category></category></item><item><title><![CDATA[更优雅的生成（策略或者工厂模式？）]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/108106103</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/108106103</guid><author>qq_38094271</author><pubDate>Wed, 19 Aug 2020 17:42:05 +0800</pubDate><description><![CDATA[傻傻的不知道怎么起文章标题
以前使用的方式
public Class A{
public static Map &lt;String,FatherClass&gt; map = new HashMap&lt;&gt;(16);

static{
map.put(son1Name,son1Class);
map.put(son2Name,son2Class);
}
}

现在使用的方式
自定义注解
@Target({ElementType.TYPE})
@Retention(RetentionPolicy.R]]></description><category></category></item><item><title><![CDATA[java 根据pid 查看进程是否存活，杀掉进程，调用python]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/108105638</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/108105638</guid><author>qq_38094271</author><pubDate>Wed, 19 Aug 2020 17:21:11 +0800</pubDate><description><![CDATA[package com.hito.indai.standalone.service.algorithm;

import cn.hutool.core.util.RuntimeUtil;
import com.hito.indai.standalone.dto.ProcessDTO;
import com.hito.indai.standalone.entity.train.TrainModel;
import com.hito.indai.standalone.enums.model.TrainStatu]]></description><category></category></item><item><title><![CDATA[java 获取GPU 信息（英伟达）]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/108105351</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/108105351</guid><author>qq_38094271</author><pubDate>Wed, 19 Aug 2020 17:16:04 +0800</pubDate><description><![CDATA[获取已用显存，总显存，gpu 名称，使用率等等
命令获取gpu信息
public class ShellService {

    @Value("${micronaut.server.port}")
    private Integer myServerPort;

    @Inject
    private TrainModelRepository trainModelRepository;

    private static HashMap&lt;String, Process&gt; p]]></description><category></category></item><item><title><![CDATA[micronaut中遇到的坑]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/106856149</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/106856149</guid><author>qq_38094271</author><pubDate>Fri, 19 Jun 2020 14:52:15 +0800</pubDate><description><![CDATA[@PostConstruct不起作用

将@Singleton 注解换成 @Context 注解， 官网上说Singleton  是懒加载模式 所以启动的时候不会调用@PostConstruct注解的方法
文件上传最大值设置的不起效果


此处设置的是10 个g 但是上传的时候发现 还是用默认的10M。我去这个值设置的类中查看（DefaultHttpClientConfiguration）发现设置进去了， 但是没起作用，但是1000MB 是起作用的，怀疑有bug 正在提Issues 给作者，我暂时解决的方案]]></description><category></category></item><item><title><![CDATA[micronaut-jpa只更新非空字段]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/106783734</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/106783734</guid><author>qq_38094271</author><pubDate>Tue, 16 Jun 2020 11:33:44 +0800</pubDate><description><![CDATA[micronaut 原生的情况
更新所有值不管是否为null
笔者接口实现逻辑
将数据库中的值查出 ，将非空值覆盖到数据库中查出的值上，最后调用update接口
代码
import io.micronaut.aop.MethodInvocationContext;
import io.micronaut.aop.chain.MethodInterceptorChain;
import io.micronaut.core.annotation.Internal;
import io.micronaut.dat]]></description><category></category></item><item><title><![CDATA[字符串明明相等 但是equals不相等]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/106356162</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/106356162</guid><author>qq_38094271</author><pubDate>Tue, 26 May 2020 14:49:08 +0800</pubDate><description><![CDATA[字符串明明相等 但是equals不相等
笔者遇到的情况是 有以下字符串
String a= “54 06 05 00 FF FB 8B 0F”  String  b= “54 06 05 00 FF FB 8B 0F”
a.euqals(b) 结果是false
于是通过toCharArray（）方法 挨个打印字符并转成ascii码 发现a 中的空格字符的ascii 是160 而 b 是32
发现 有个空格叫不间断空格 就是网页上的&amp;npsb ，而32 是普通空格。网上的正则过滤没有用  于是自己写了]]></description><category></category></item><item><title><![CDATA[hive，hdfs , mysql]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/88423904</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/88423904</guid><author>qq_38094271</author><pubDate>Mon, 25 Mar 2019 14:24:54 +0800</pubDate><description><![CDATA[将本地文件导入hive中
导包前我们先建表
建表语句

create table order_mulit_partition(order_number string,event_time string)
PARTITIONED BY(event_month string, step string) 
row format delimited 
fields terminated by '\t';
...]]></description><category></category></item><item><title><![CDATA[activeMQ 的简单运用]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/88709961</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/88709961</guid><author>qq_38094271</author><pubDate>Thu, 21 Mar 2019 11:10:46 +0800</pubDate><description><![CDATA[文章目录客户端生产端pom
客户端

package com.zhuguang.jack.queue;

import org.apache.activemq.ActiveMQConnectionFactory;

import javax.jms.*;
import java.io.File;
import java.io.FileNotFoundException;
import java.i...]]></description><category></category></item><item><title><![CDATA[spring 中AbstractApplicationContext的refresh方法]]></title><link>https://blog.youkuaiyun.com/qq_38094271/article/details/85269342</link><guid>https://blog.youkuaiyun.com/qq_38094271/article/details/85269342</guid><author>qq_38094271</author><pubDate>Wed, 26 Dec 2018 21:40:46 +0800</pubDate><description><![CDATA[文章目录obtainFreshBeanFactoryrefreshBeanFactoryloadBeanDefinitions解析标签解析自定义标签
	@Override
	public void refresh() throws BeansException, IllegalStateException {
		synchronized (this.startupShutdownMonitor)...]]></description><category></category></item></channel></rss>