<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[yyf960126的博客]]></title><description><![CDATA[java转型大数据]]></description><link>https://blog.youkuaiyun.com/yyf960126</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; yyf960126]]></copyright><item><title><![CDATA[spark-sql在yarn环境启动时报错虚拟内存溢出]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148847822</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148847822</guid><author>yyf960126</author><pubDate>Mon, 23 Jun 2025 15:32:45 +0800</pubDate><description><![CDATA[beyond the 'VIRTUAL' memory limit. Current usage: 345.5 MB of 1 GB physical memory used; 2.2 GB of 2.1 GB virtual memory used. Killing container.]]></description><category></category></item><item><title><![CDATA[Application with id application_xxx doesn‘t exist in RM解决方法]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148597359</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148597359</guid><author>yyf960126</author><pubDate>Thu, 12 Jun 2025 11:43:06 +0800</pubDate><description><![CDATA[Application with id application_xxx doesn't exist in RM]]></description><category></category></item><item><title><![CDATA[Flinkcdc读取mysqlbinlog时报错Cannot read the binlog filename and position via ‘SHOW MASTER STATUS‘.]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148557714</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148557714</guid><author>yyf960126</author><pubDate>Tue, 10 Jun 2025 12:07:37 +0800</pubDate><description><![CDATA[Cannot read the binlog filename and position via 'SHOW MASTER STATUS'. Make sure your server is correctly configured]]></description><category></category></item><item><title><![CDATA[hadoop集群datanode启动显示init failed，不能解析hostname]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148449278</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148449278</guid><author>yyf960126</author><pubDate>Thu, 05 Jun 2025 14:17:07 +0800</pubDate><description><![CDATA[ps:在没修改网卡信息之前网上搜到还有一种方法，修改hdfs-site.xml,新增一条配置dfs.namenode.datanode.registration.ip-hostname-check，不进行地址检查。把这个值修改成none或者是static都可以，查看网卡信息只显示一条了，之后再把data和logs删掉，重启一下集群就可以了。之后倒是能启动集群，只不过webUi上datanode等的地址变成了动态分布的ip地址，如图。文章浏览阅读255次。三个datanode集群，有一个总是起不起来。]]></description><category></category></item><item><title><![CDATA[Flink集群搭建和部署运行模式]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148411893</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148411893</guid><author>yyf960126</author><pubDate>Wed, 04 Jun 2025 00:30:39 +0800</pubDate><description><![CDATA[Flink集群搭建和部署运行模式]]></description><category></category></item><item><title><![CDATA[maven在修改完配置之后新建项目还是不生效的原因]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148402355</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148402355</guid><author>yyf960126</author><pubDate>Tue, 03 Jun 2025 15:17:50 +0800</pubDate><description><![CDATA[maven在修改完配置之后新建项目还是不生效的原因]]></description><category></category></item><item><title><![CDATA[运行shell脚本时报错/bin/bash^M: 解释器错误: 没有那个文件或目录]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148397317</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148397317</guid><author>yyf960126</author><pubDate>Tue, 03 Jun 2025 11:08:36 +0800</pubDate><description><![CDATA[运行shell脚本时报错/bin/bash^M: 解释器错误: 没有那个文件或目录]]></description><category></category></item><item><title><![CDATA[启动metastore时报错MetaException(message:Version information not found in metastore]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148386543</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148386543</guid><author>yyf960126</author><pubDate>Mon, 02 Jun 2025 20:53:43 +0800</pubDate><description><![CDATA[启动metastore时报错MetaException(message:Version information not found in metastore]]></description><category></category></item><item><title><![CDATA[centos8修改IP地址和Hostname]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148383088</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148383088</guid><author>yyf960126</author><pubDate>Mon, 02 Jun 2025 16:09:54 +0800</pubDate><description><![CDATA[centos8修改IP地址和Hostname。及网卡未开启的解决方法]]></description><category></category></item><item><title><![CDATA[Flink系列文章列表]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148267007</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148267007</guid><author>yyf960126</author><pubDate>Tue, 27 May 2025 23:20:30 +0800</pubDate><description><![CDATA[把写的文章做一个汇总，会陆续更新的。]]></description><category></category></item><item><title><![CDATA[vertica优化]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148238121</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148238121</guid><author>yyf960126</author><pubDate>Mon, 26 May 2025 19:19:54 +0800</pubDate><description><![CDATA[数据或中间结果按照关联等字段重新分布到每个节点，如果需要得到数据全集，则需要合并每个节点上的记录。找到之前年度汇报的ppt，把优化方法分享一下，也做一个留存。会在关联操作前将参加关联的另一个表表进行排序，然后再进行。按照关联字段预先排好序，那么优化器会选择更有效率的。数据量比较大的时候，要是创建临时表的话需要使用。如果只有一张表是按照关联字段预先排序，那么。数据量比较小的时候，创建临时表的话使用。来创建临时表，实体表的话需要重新设计。操作中额外的排序及数据传输操作，提升。的定义以及查询内容，选择最合适的。]]></description><category></category></item><item><title><![CDATA[Paimon和Hive相集成]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148144761</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148144761</guid><author>yyf960126</author><pubDate>Thu, 22 May 2025 17:53:58 +0800</pubDate><description><![CDATA[Paimon版本1.17Hive版本3.1.3。]]></description><category></category></item><item><title><![CDATA[数据仓库工具箱第三版——读书笔记（未完）]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/148086599</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/148086599</guid><author>yyf960126</author><pubDate>Thu, 22 May 2025 16:17:44 +0800</pubDate><description><![CDATA[3.4.1、可计算获得的事实：例如收入字段，收入=原价格-优惠券优惠的价格。变化的度量应该被存储在事实表中。业务需要按照非标准的日期属性对日期进行分片，需要建立一个详尽的日期维度表，而不是由应用代码解决，原子事务事实表的粒度可在事务环境下被简洁地描述,例如,每个事务一行或 个事务线一行。设计计算的数据应该放入事实表中，涉及约束、分组和标记的数据应该放入维度表中。详细的粒度说明确定了事实表的束腰维度，可以将更多维度增加到事实表上，由于这些事实表记录的是一个事务事件,所以它们通常是比较稀疏的。]]></description><category></category></item><item><title><![CDATA[paimon和flink集成后批和流查看过去的快照的数据及变动的数据]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/147930584</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/147930584</guid><author>yyf960126</author><pubDate>Tue, 13 May 2025 22:52:43 +0800</pubDate><description><![CDATA[paimon中批和流查看过去的快照的数据及变动的数据]]></description><category></category></item><item><title><![CDATA[hiveserver2与beeline进行远程连接hive配置及遇到的问题]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/147907549</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/147907549</guid><author>yyf960126</author><pubDate>Tue, 13 May 2025 00:15:31 +0800</pubDate><description><![CDATA[hiveserver2与beeline进行远程连接hive配置及遇到的问题]]></description><category></category></item><item><title><![CDATA[hive在配置文件中添加了hive.metastore.uris之后进入hive输入命令报错]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/147901728</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/147901728</guid><author>yyf960126</author><pubDate>Mon, 12 May 2025 18:06:34 +0800</pubDate><description><![CDATA[hive在配置文件中添加了hive.metastore.uris之后进入hive输入命令报错]]></description><category></category></item><item><title><![CDATA[mysql连接时候报错：error while loading shared libraries: libncurses.so.5: cannot open shared object file]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/147566653</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/147566653</guid><author>yyf960126</author><pubDate>Sun, 27 Apr 2025 19:01:15 +0800</pubDate><description><![CDATA[mysql在linux命令进入时报错]]></description><category></category></item><item><title><![CDATA[shell脚本传递参数]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/140362563</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/140362563</guid><author>yyf960126</author><pubDate>Thu, 11 Jul 2024 21:51:04 +0800</pubDate><description><![CDATA[【代码】shell脚本传递参数。]]></description><category></category></item><item><title><![CDATA[SQL中的LAG函数与LEAD函数用法]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/128412568</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/128412568</guid><author>yyf960126</author><pubDate>Sat, 11 May 2024 20:01:44 +0800</pubDate><description><![CDATA[SQL中的LAG函数与LEAD函数用法]]></description><category></category></item><item><title><![CDATA[hive中一行用分隔符切割成多行]]></title><link>https://blog.youkuaiyun.com/yyf960126/article/details/135343970</link><guid>https://blog.youkuaiyun.com/yyf960126/article/details/135343970</guid><author>yyf960126</author><pubDate>Tue, 02 Jan 2024 16:25:11 +0800</pubDate><description><![CDATA[hive中一行用分隔符切割成多行]]></description><category></category></item></channel></rss>