<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[LAFEU的专栏]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/LAFEU</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; LAFEU]]></copyright><item><title><![CDATA[ipv4与十进制整数的转换]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/138164719</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/138164719</guid><author>LAFEU</author><pubDate>Wed, 24 Apr 2024 17:23:34 +0800</pubDate><description><![CDATA[样例数据：184.153.243.168 和 3097097128。1、ipv4转十进制整数。2、十进制整数转ipv4。]]></description><category></category></item><item><title><![CDATA[IDEA工具栏显示]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/134582509</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/134582509</guid><author>LAFEU</author><pubDate>Thu, 23 Nov 2023 17:25:12 +0800</pubDate><description><![CDATA[视图 | 外观 主菜单          的右侧有开启和关闭，点击开启，工具栏就出来了。退出微信、钉钉等可能起快捷键冲突的app;CTRL+SHIFT+A ，输入menu。]]></description><category></category></item><item><title><![CDATA[指定文件格式写入hdfs目录]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/134059712</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/134059712</guid><author>LAFEU</author><pubDate>Thu, 26 Oct 2023 16:39:40 +0800</pubDate><description><![CDATA[insert overwrite directory '/dw/ads/ads_dailyreport_rcfile/dt=20231024' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LINES TERMINATED BY '\n' NULL DEFINED AS '' STORED AS rcfile
 select user_level,uv from dailyreport_info where dt='20231024']]></description><category></category></item><item><title><![CDATA[连续签到的天数]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/117397965</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/117397965</guid><author>LAFEU</author><pubDate>Sun, 30 May 2021 14:27:24 +0800</pubDate><description><![CDATA[&lt;题目&gt;

给定一张用户签到表user_attendence，表中包含三个字段，分别是用户ID：【user_id】，日期：【date】，是否签到：【is_sign_in】，0否1是。

&lt;问题1&gt;计算截至当前，每个用户已经连续签到的天数：

要求输出用户ID【user_id】和连续签到天数【recent_continuous_days】
...]]></description><category></category></item><item><title><![CDATA[is running beyond physical memory limits]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/104646472</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/104646472</guid><author>LAFEU</author><pubDate>Wed, 04 Mar 2020 08:29:31 +0800</pubDate><description><![CDATA[问题：Diagnostics: Container [pid=39140,containerID=container_e10_1565335325310_20621_02_000001] is running beyond physical memory limits. Current usage: 4.5 GB of 4.5 GB physical memory used; 6.6 GB of ...]]></description><category></category></item><item><title><![CDATA[org.apache.hadoop.ipc.RemoteException]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/100292142</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/100292142</guid><author>LAFEU</author><pubDate>Mon, 02 Sep 2019 15:25:47 +0800</pubDate><description><![CDATA[Job Submission failed with exception 'org.apache.hadoop.ipc.RemoteException(File /tmp/hadoop-yarn/staging/gongsi/.staging/job_1565942010093_25147/libjars/commons-compress-1.4.1.jar could only be repli...]]></description><category></category></item><item><title><![CDATA[jdk版本卸载安装mac]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/100291537</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/100291537</guid><author>LAFEU</author><pubDate>Mon, 02 Sep 2019 15:24:08 +0800</pubDate><description><![CDATA[1 终端执行：
sudo rm -rf /Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk
sudo rm -rf /Library/Java/JavaVirtualMachines/jdk1.8.0_40.jdk
sudo rm -rf /Library/PreferencePanes/JavaControlPanel.prefPane
sudo ...]]></description><category></category></item><item><title><![CDATA[简述如何得到map 个数]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/100015237</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/100015237</guid><author>LAFEU</author><pubDate>Thu, 22 Aug 2019 15:11:27 +0800</pubDate><description><![CDATA[我总结的还待改进：

dfs.block.size=128 集群块的大小

total_size 每个文件的大小；

default_num =total_size/dfs.block.size ;

default_num =max(default_num,集群默认2)

可以根据map.mapred.task 来指定map数量，前提是，这个数量大于split_num 生效；

还有两个...]]></description><category></category></item><item><title><![CDATA[根据价格变动求销售总量，有日期跨度的]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/100015105</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/100015105</guid><author>LAFEU</author><pubDate>Thu, 22 Aug 2019 14:53:15 +0800</pubDate><description><![CDATA[问题：有一张表存了每天货品的销量，另一张表存了每个物品一年内的价格变化，这个价格表是只有价格变化才会有记录，所以这张表日期不全 ，如何计算每个商品一年的销售总价？

一、下面是我写的sql，如果你有更好的办法请不吝指教 ~

select s1.name,sum(s1.num*s2.salary)
from  销量 s1
join
(
  -- 每个商品每天对应的最近的单价
  sel...]]></description><category></category></item><item><title><![CDATA[presto,hive查询比较，presto缺点]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/89382590</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/89382590</guid><author>LAFEU</author><pubDate>Thu, 18 Apr 2019 16:51:28 +0800</pubDate><description><![CDATA[presto:default&gt; select * from mds_bhv where dt='20190319' limit 10;

Query 20190418_083902_00583_dewqj, FAILED, 1 node
Splits: 17 total, 0 done (0.00%)
0:00 [0 rows, 0B] [0 rows/s, 0B/s]

Query 201...]]></description><category></category></item><item><title><![CDATA[Mac 添加 hosts]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/89338373</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/89338373</guid><author>LAFEU</author><pubDate>Tue, 16 Apr 2019 17:48:32 +0800</pubDate><description><![CDATA[Mac OSX的hosts文件位于/private/etc/hosts。

记得用sudo权限编辑即可。在文件中添加如下内容：

xxx.xxx.xxx.xxx (ip地址) abc.com(你的host名称)
]]></description><category></category></item><item><title><![CDATA[java.lang.IllegalArgumentException: Illegal pattern component: XXX]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/89334971</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/89334971</guid><author>LAFEU</author><pubDate>Tue, 16 Apr 2019 15:45:44 +0800</pubDate><description><![CDATA[问题、Spark bug：java.lang.IllegalArgumentException: Illegal pattern component: XXX 解决办法

原因概述：代码用到了调用spark.read.json，maven升级的时候，没有自动加载完整依赖包

解决方式

手动增加lang包的依赖，在pom文件里面增加：

&lt;dependency&gt;

&lt...]]></description><category></category></item><item><title><![CDATA[Error while instantiating 'org.apache.spark.sql.hive.HiveSessionStateBuilder']]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/89334925</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/89334925</guid><author>LAFEU</author><pubDate>Tue, 16 Apr 2019 15:44:51 +0800</pubDate><description><![CDATA[问题 User class threw exception: java.lang.IllegalArgumentException: Error while instantiating 'org.apache.spark.sql.hive.HiveSessionStateBuilder':

解决：代码里config 配置信息异常；hive.exec.scratchdir 的配置拼写异常
...]]></description><category></category></item><item><title><![CDATA[org.apache.spark.sql.AnalysisException: Table or view not found: testtable]]></title><link>https://blog.youkuaiyun.com/LAFEU/article/details/89334888</link><guid>https://blog.youkuaiyun.com/LAFEU/article/details/89334888</guid><author>LAFEU</author><pubDate>Tue, 16 Apr 2019 15:43:42 +0800</pubDate><description><![CDATA[问题 User class threw exception: org.apache.spark.sql.AnalysisException: Table or view not found: testtable; line 1 ；

解决办法，引入--files /data0/spark/spark-2.2.1-bin/conf/hive-site.xml

...]]></description><category></category></item></channel></rss>