<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[htmljsp的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/htmljsp</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; htmljsp]]></copyright><item><title><![CDATA[clickhouse技术细节整理]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/134948363</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/134948363</guid><author>htmljsp</author><pubDate>Tue, 12 Dec 2023 14:15:01 +0800</pubDate><description><![CDATA[这里的分布式JOIN通常指，JOIN查询中涉及到的left_table 与 right_table 是分布式表。ClickHouse集群并未实现完整意义上的Shuffle JOIN，实现了类Broadcast JOIN，通过事先完成数据重分布，能够实现Colocate JOIN。ClickHouse 的分布式JOIN查询可以分为两类，带GLOBAL关键字的，和不带GLOBAL关键字的情况。在实际中，我们通常将较小的表作为右表，并尽可能增加过滤条件，降低进入JOIN计算的数据量。分布式JOIN最佳实践。]]></description><category></category></item><item><title><![CDATA[数字孪生信息收集]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/134947516</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/134947516</guid><author>htmljsp</author><pubDate>Tue, 12 Dec 2023 14:12:54 +0800</pubDate><description><![CDATA[数字孪生是指：充分利用物理模型、传感器更新、运行历史等数据，形成多学科、多物理量、多时间尺度、多概率的仿真过程， 进而反映物理系统全生命周期过程的信息技术。数字孪生基于传感数据和高精度仿真等手段构建物理实体的数字镜像，使难以用数理模型解析预测的复杂系统问题在信息域可观、便于预测和控制，为实现信息物理系统(Cyber physical system, CPS)提供了清晰的新思路、方法和实施途径。]]></description><category></category></item><item><title><![CDATA[doris安装和supervisor监控]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/127358716</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/127358716</guid><author>htmljsp</author><pubDate>Mon, 17 Oct 2022 10:30:19 +0800</pubDate><description><![CDATA[doris 1.1.2最新版本安装   supervisor监控 自动重启等操作]]></description><category></category></item><item><title><![CDATA[supervisor监控doris_be]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/126857690</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/126857690</guid><author>htmljsp</author><pubDate>Wed, 14 Sep 2022 18:15:38 +0800</pubDate><description><![CDATA[doris_be 发生异常中断关闭问题，做一个监控重启的机制]]></description><category></category></item><item><title><![CDATA[redash安装-2022年最新版本-非docker方式]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/126194715</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/126194715</guid><author>htmljsp</author><pubDate>Sat, 06 Aug 2022 14:41:16 +0800</pubDate><description><![CDATA[本地 centos 7 系统安装 redhash ，非docker方式]]></description><category></category></item><item><title><![CDATA[程序员关爱-坐姿检测-设计思路及使用与下载]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/125679729</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/125679729</guid><author>htmljsp</author><pubDate>Fri, 08 Jul 2022 15:55:59 +0800</pubDate><description><![CDATA[坐姿不正 弹窗来叫，人脸识别 坐姿矫正 ]]></description><category></category></item><item><title><![CDATA[朝阳区幼升小-2022年]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/124725786</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/124725786</guid><author>htmljsp</author><pubDate>Thu, 12 May 2022 10:31:47 +0800</pubDate><description><![CDATA[北京义务教育入学服务平台
注册获取-儿童信息采集表编号：https://yjrx.bjedu.cn/
朝阳区义务教育阶段入学转学报名系统：
http://yjrxbm.bjchyedu.cn/distribution/UploadSingleSchoolPic
查询小区对应学校：
http://xqcx.bjchyedu.cn/
当前时间无法预约 - 问题
统筹分配报名-&gt;预约时：2022年05月份的日期，点击是提示：“当前时间无法预约 ”。
需要跳转到06月份，点击激活的日期，可以进行预约，当前20]]></description><category></category></item><item><title><![CDATA[HDFS常规操作]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/123839167</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/123839167</guid><author>htmljsp</author><pubDate>Wed, 30 Mar 2022 10:05:27 +0800</pubDate><description><![CDATA[HDFS文件统计


获取指定目录数据大小信息
hdfs dfs -du /user/hive/warehouse/ods.db/ &gt; db_du


获取指定目录修改时间信息
hdfs dfs -ls /user/hive/warehouse/udm.db/ &gt; db_ls


合并信息脚本
#!/usr/bin/perl
use strict;
my %table_du = map{my @m = split /\s+/;m[0],m[0],m[0],m[1]} awk -F'[ /]' ']]></description><category></category></item><item><title><![CDATA[Flink on yarn Yarn-Per-Job 作业日志 查询 方式记录]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/123636481</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/123636481</guid><author>htmljsp</author><pubDate>Mon, 21 Mar 2022 15:17:26 +0800</pubDate><description><![CDATA[Flink 日志查询命令
获取application的contain信息

yarn logs -show_application_log_info --applicationId  application_1639366579669_896581

WARNING: YARN_OPTS has been replaced by HADOOP_OPTS. Using value of YARN_OPTS.
Application State: Completed.
Container: container_]]></description><category></category></item><item><title><![CDATA[Flink任务部署-deply总结]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/123551539</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/123551539</guid><author>htmljsp</author><pubDate>Thu, 17 Mar 2022 15:23:14 +0800</pubDate><description><![CDATA[Flink作业deploy

https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/overview/
https://nightlies.apache.org/flink/flink-docs-release-1.13/zh/docs/deployment/resource-providers/yarn/
https://nightlies.apache.org/flink/flink-docs-release]]></description><category></category></item><item><title><![CDATA[yanagishima 23.0 编译 安装 编译完成版本下载]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/121426859</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/121426859</guid><author>htmljsp</author><pubDate>Fri, 19 Nov 2021 17:07:02 +0800</pubDate><description><![CDATA[trino 357 
yanagishima v23.0

export JAVA_HOME=/home/bduser/zulu-jdk11.0.10
echo PATH=/home/bduser/zulu-jdk11.0.10/bin:$PATH
export PATH=/home/bduser/zulu-jdk11.0.10/bin:$PATH

wget https://services.gradle.org/distributions/gradle-6.8.2-bin.zip
unzip gradl]]></description><category></category></item><item><title><![CDATA[github验证更换操作]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/119738045</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/119738045</guid><author>htmljsp</author><pubDate>Mon, 16 Aug 2021 17:38:03 +0800</pubDate><description><![CDATA[github验证更换操作
8月13日后 git pull操作报错
Support for password authentication was removed on August 13, 2021. Please use a personal access tok

原因

github 网站更新了验证方式

token验证配置
1.登录github账号，点击settings，点击Developer settings
2.点击Personal access tokens
3. 点击Generate new]]></description><category></category></item><item><title><![CDATA[hive 异常ClassCastException]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/116460885</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/116460885</guid><author>htmljsp</author><pubDate>Thu, 06 May 2021 19:18:42 +0800</pubDate><description><![CDATA[hive升级过程中异常记录-java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.OrcStruct cannot be cast to org.apache.hadoop.io.BinaryComparable
常规ClassCastException问题梳理-来源网络
Caused by: java.lang.ClassCastException: org.apache.hadoop.io.Text cannot be cast t]]></description><category></category></item><item><title><![CDATA[kettle - 问题记录 及 解决方案]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/113390340</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/113390340</guid><author>htmljsp</author><pubDate>Fri, 29 Jan 2021 15:21:35 +0800</pubDate><description><![CDATA[数据源配置文件路径
kettle任务启动是：
a. 优先查看 $KETTLE_HOME目录下 .kettle文件夹的配置文件。
b. 如果找不到  $KETTLE_HOME变量，则到用户个目录下，查找.kettle文件夹。


]]></description><category></category></item><item><title><![CDATA[atlas使用记录]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/111033397</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/111033397</guid><author>htmljsp</author><pubDate>Fri, 11 Dec 2020 13:25:28 +0800</pubDate><description><![CDATA[请空hbase中的表的命令


echo "truncate 'apache_atlas_janus'" | /opt/atlas2.0/apache-atlas-2.0.0/hbase/bin/hbase shell


清空solr的altas对应的index命令


curl http://192.168.2.202:9838/solr/edge_index/update --data-binary "*:*" -H 'Content-type:text/xml; charset=utf-8' 
cu]]></description><category></category></item><item><title><![CDATA[kettle使用MongoDB Input连接mongodb获取数据异常处理记录]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/110648909</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/110648909</guid><author>htmljsp</author><pubDate>Fri, 04 Dec 2020 15:44:00 +0800</pubDate><description><![CDATA[kettle 使用 连接mongodb ，报错处理

com.mongodb.MongoCommandException: Command failed with error 16436: 'Unrecognized pipeline stage name: 'ADD_TIME'' on server 192.168.2.144:27017. The full response is { "ok" : 0.0, "errmsg" : "Unrecognized pipeline stage name: 'A]]></description><category></category></item><item><title><![CDATA[clickhouse版本升级-保留数据]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/109221378</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/109221378</guid><author>htmljsp</author><pubDate>Thu, 22 Oct 2020 14:44:14 +0800</pubDate><description><![CDATA[操作准备

版本升级


19.11.7.40 升级到 20.9.2.20


系统版本


CentOS Linux release 7.4.1708 (Core)  	( #cat /etc/redhat-release)


显示命令：


yum list installed ‘clickhouse*’


卸载命令


yum -y remove …


安装命令


sudo yum -y localinstall clickhouse-*.rpm

升级流程

下载新版本文件(配置文件需要安装]]></description><category></category></item><item><title><![CDATA[DATAHUB 调研测试文档]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/107519816</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/107519816</guid><author>htmljsp</author><pubDate>Wed, 22 Jul 2020 18:39:17 +0800</pubDate><description><![CDATA[DATAHUB 调研测试文档
李达 20200710 lida2012@foxmail.com
1.环境安装
服务器配置：
服务器ip：192.168.123.80
系统版本：CentOS Linux release 7.4.1708 (Core)
Cpu：2核ntel(R) Celeron(R) CPU 1007U @ 1.50GHz
内存：8g
硬盘：50G系统硬盘 + 1T挂载硬盘

2.docker部署
2.1.Docker安装

https://github.com/linkedin/datahu]]></description><category></category></item><item><title><![CDATA[jenkins使用及持续集成]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/84995089</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/84995089</guid><author>htmljsp</author><pubDate>Mon, 17 Dec 2018 17:35:23 +0800</pubDate><description><![CDATA[一.Jenkins安装

1.1软件信息

Web服务器:http://archive.apache.org/dist/tomcat/tomcat-7/v7.0.5-beta/bin/apache-tomcat-7.0.5.tar.gz
	Jenkins版本:http://ftp.yz.yamagata-u.ac.jp/pub/misc/jenkins/war-stable/2.19.4/jenk...]]></description><category></category></item><item><title><![CDATA[版本控制系统GIT文档]]></title><link>https://blog.youkuaiyun.com/htmljsp/article/details/84994994</link><guid>https://blog.youkuaiyun.com/htmljsp/article/details/84994994</guid><author>htmljsp</author><pubDate>Thu, 13 Dec 2018 21:03:39 +0800</pubDate><description><![CDATA[版本控制系统GIT文档

李达 20180629

引用博客教程+实践总结

目录
1.     版本控制系统... 2
1.1.      简介... 2
1.2.      常见的版本控制器... 3
1.3.      版本控制分类... 4
1.3.1.       本地版本控制... 4
1.3.2.       集中版本控制（SVN）... 4
1.3.3.       分布式版本控制...]]></description><category></category></item></channel></rss>