<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[flashtown的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/flashtown</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; flashtown]]></copyright><item><title><![CDATA[pandas.errors.InvalidIndexError: Reindexing only valid with uniquely valued Index objects（删除重复的索引）]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/139628016</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/139628016</guid><author>flashtown</author><pubDate>Wed, 12 Jun 2024 15:27:44 +0800</pubDate><description><![CDATA[原因： 读取多个数据文件 input_data 后,用append() 方法合并数据集,没用单独管索引。现象：打印数据会发现 df 数据集的索引 存在多个 0，1，2，3（每个数据文件都有单独索引）解决：df=input_data.append(df,ignore_index=True)]]></description><category></category></item><item><title><![CDATA[数据脚本迁移一般流程]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/123530335</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/123530335</guid><author>flashtown</author><pubDate>Wed, 16 Mar 2022 16:53:24 +0800</pubDate><description><![CDATA[1.创建目标表

2.梳理脚本中的上游依赖

3.申请上游表权限并转义脚本（同一数据库一般迁移只改表名就好，跨数据库迁移脚本可能存在sql函数不通用）

4.脚本逻辑测试（上游得有数据，迁移的一堆脚本中的依赖关系也得梳理好），有条件把数据提前核对好

5.投产上线

6.核对投产前后数据。如存在数据不一致就定位问题


...]]></description><category></category></item><item><title><![CDATA[常用数据库]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/122884339</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/122884339</guid><author>flashtown</author><pubDate>Fri, 11 Feb 2022 17:02:47 +0800</pubDate><description><![CDATA[银行常用数据库有

TD：Teradata数据库

GP:Greenplum数据库

GS:Guass数据库

以及大数据环境的hive数据库；

由于国产化数据库改革，以前TD和GP数据库在向GS和hive上迁移；

其他数据库如MySQL和Oracle数据库本人在项目中并没有怎么接触到；

感觉GS数据库和hive还是挺好的，在GP脚本迁移GS中部分函数不通用，数据核对个别函数可能会有问题；GS或者GP脚本迁移hive中一样，脚本转义和最后的数据核对是最费时间的。
...]]></description><category></category></item><item><title><![CDATA[sparkstreaming整合kafka运行报错]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/110387688</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/110387688</guid><author>flashtown</author><pubDate>Mon, 30 Nov 2020 14:31:37 +0800</pubDate><description><![CDATA[20/11/30 14:24:47 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(flashtown); groups with view permissions: Set(); users with modify permissions: Set(flashtown); groups with modify permis..]]></description><category></category></item><item><title><![CDATA[Flume  source and sink]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/109855075</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/109855075</guid><author>flashtown</author><pubDate>Fri, 20 Nov 2020 17:47:50 +0800</pubDate><description><![CDATA[flume 实时从netcat采集数据到hdfs

先从官网 http://flume.apache.org/releases/content/1.9.0/FlumeUserGuide.html#flume-sinks 拷贝样例

然后将sink 为logger改为hdfs

在hdfs sink中拷贝sink样例 ，并增加了三行代码


# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

.]]></description><category></category></item><item><title><![CDATA[Refused to apply style from ‘http://localhost:63342/demo4/templates/css/zTreeStyle/zTreeStyle.css‘ b]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107833684</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107833684</guid><author>flashtown</author><pubDate>Thu, 06 Aug 2020 10:35:49 +0800</pubDate><description><![CDATA[这个问题还未解决，等着解决了回来写一下。
]]></description><category></category></item><item><title><![CDATA[Error creating bean with name ‘entityManagerFactory‘ defined in class path resource [org/springframe]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107708722</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107708722</guid><author>flashtown</author><pubDate>Fri, 31 Jul 2020 10:56:18 +0800</pubDate><description><![CDATA[报错：Error creating bean with name 'entityManagerFactory' defined in class path resource [org/springframework/boot/autoconfigure/orm/jpa/HibernateJpaConfiguration.class]: Invocation of init method failed; nested exception is java.lang.NoClassDefFoundError: j]]></description><category></category></item><item><title><![CDATA[@TableName和@TableId爆红时，加入pom依赖]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107616413</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107616413</guid><author>flashtown</author><pubDate>Mon, 27 Jul 2020 17:17:16 +0800</pubDate><description><![CDATA[&lt;dependency&gt;
            &lt;groupId&gt;com.baomidou&lt;/groupId&gt;
            &lt;artifactId&gt;mybatis-plus-boot-starter&lt;/artifactId&gt;
            &lt;version&gt;3.2.0&lt;/version&gt;
        &lt;/dependency&gt;


]]></description><category></category></item><item><title><![CDATA[JSONObject.fromObject爆红，显示无fromObject方法]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107615769</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107615769</guid><author>flashtown</author><pubDate>Mon, 27 Jul 2020 16:57:32 +0800</pubDate><description><![CDATA[&lt;!--JSONArray.fromObject爆红--&gt;
        &lt;dependency&gt;
            &lt;groupId&gt;net.sf.json-lib&lt;/groupId&gt;
            &lt;artifactId&gt;json-lib&lt;/artifactId&gt;
            &lt;version&gt;2.4&lt;/version&gt;
            &lt;classifier&g.]]></description><category></category></item><item><title><![CDATA[@RestController不能正常跳转页面，显示结果仍是return值]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107565859</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107565859</guid><author>flashtown</author><pubDate>Fri, 24 Jul 2020 17:25:07 +0800</pubDate><description><![CDATA[配置信息没有出错，将注解@RestController改为@Controller，居然能够跳转到前端的页面了。



@Controller
public class TestController {
    @Autowired
   private  BaseClassService baseClassService;

    @ResponseBody
    @RequestMapping("/hello")    
    public String hello(){
        retur]]></description><category></category></item><item><title><![CDATA[The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than one time zone. 报错]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107558647</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107558647</guid><author>flashtown</author><pubDate>Fri, 24 Jul 2020 12:45:41 +0800</pubDate><description><![CDATA[在数据源的url处加上


&amp;serverTimezone=Asia/Shanghai

例如：


spring.datasource.url=jdbc:mysql://localhost:3306/test1?useUnicode=true&amp;characterEncoding=utf-8&amp;useSSL=false&amp;serverTimezone=Asia/Shanghai



]]></description><category></category></item><item><title><![CDATA[This application has no explicit mapping for /error, so you are seeing this as a fallback.]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107516211</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107516211</guid><author>flashtown</author><pubDate>Wed, 22 Jul 2020 16:16:07 +0800</pubDate><description><![CDATA[在springboot项目中可能是由于启动类没有在最外侧，controller、mapper、service、model都应该在启动类同级以下的包
]]></description><category></category></item><item><title><![CDATA[显示401，但没有报错信息]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107322520</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107322520</guid><author>flashtown</author><pubDate>Mon, 13 Jul 2020 18:22:13 +0800</pubDate><description><![CDATA[在配置信息中加入


server.security.oauth=false
]]></description><category></category></item><item><title><![CDATA[报错：Parameter ‘type‘ not found. Available parameters are [arg3, arg2, arg1, arg0, param3,]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107227430</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107227430</guid><author>flashtown</author><pubDate>Thu, 09 Jul 2020 14:15:30 +0800</pubDate><description><![CDATA[在传入的参数 String type、String branchName 、String level 前加上@Param(" ") 即可


]]></description><category></category></item><item><title><![CDATA[第一次用IDEA创建maven工程时间]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/107070256</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/107070256</guid><author>flashtown</author><pubDate>Wed, 01 Jul 2020 19:14:41 +0800</pubDate><description><![CDATA[第一次在idea中创建maven工程花费20+min
欢迎使用Markdown编辑器
你好！ 这是你第一次使用 Markdown编辑器 所展示的欢迎页。如果你想学习如何使用Markdown编辑器, 可以仔细阅读这篇文章，了解一下Markdown的基本语法知识。
新的改变
我们对Markdown编辑器进行了一些功能拓展与语法支持，除了标准的Markdown编辑器功能，我们增加了如下几点新功能，帮助你用它写博客：

全新的界面设计 ，将会带来全新的写作体验；
在创作中心设置你喜爱的代码高亮样式，Markdown]]></description><category></category></item><item><title><![CDATA[java进制转化方法]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/99967996</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/99967996</guid><author>flashtown</author><pubDate>Wed, 21 Aug 2019 16:20:52 +0800</pubDate><description><![CDATA[1.常用的进制方法

     注：标红常用

    System.out.println(Integer.parseInt("1001",16));//4097  十六进制转化十进制
   System.out.println(Integer.valueOf("1001", 16)); //4097  十六进制转化十进制     
 ...]]></description><category></category></item><item><title><![CDATA[解决 Can not call getNString() when field's charset isn't UTF-8]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/99754853</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/99754853</guid><author>flashtown</author><pubDate>Mon, 19 Aug 2019 19:46:53 +0800</pubDate><description><![CDATA[错误翻译为：
当字段的字符集不是utf-8时，无法调用getnstring（）。

当自己把数据库的字符集设置为utf-8后，还是没有效果。



解决方法：

将数据库表中所有字段都设置成utf-8即可。

在mysql数据库中执行：alter table `表名` convert to character set utf8 

解决这个问题了




...]]></description><category></category></item><item><title><![CDATA[java.sql.SQLException: Unknown initial character set index '255' received from server. .....]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/99705238</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/99705238</guid><author>flashtown</author><pubDate>Sun, 18 Aug 2019 15:39:34 +0800</pubDate><description><![CDATA[开始出现错误（1）

java.sql.SQLException:Unknowninitialcharactersetindex'255'receivedfromserver.Initialclientcharactersetcanbeforcedviathe'characterEncoding'property.错误提示

根据提示在连接数据库时增加编码
...]]></description><category></category></item><item><title><![CDATA[Eclipse 视图看不见Referenced Libraries]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/99679986</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/99679986</guid><author>flashtown</author><pubDate>Fri, 16 Aug 2019 16:02:58 +0800</pubDate><description><![CDATA[一般java工程按照网上所说的3个步骤可以找到，没找到可以呀直接在项目中复制jar包，build path就出现了：

1.javaEE改成java



2.菜单Window-&gt;Show View-&gt;Other-&gt;Java-&gt;Package Explorer



3.左侧视图中找到倒三角，设置Show Referenced Libraries



4.还是没有找到Re...]]></description><category></category></item><item><title><![CDATA[jsp&servlet（2）]]></title><link>https://blog.youkuaiyun.com/flashtown/article/details/96181828</link><guid>https://blog.youkuaiyun.com/flashtown/article/details/96181828</guid><author>flashtown</author><pubDate>Tue, 16 Jul 2019 20:42:10 +0800</pubDate><description><![CDATA[servlet的会话管理

实现会话的基本方式：

（1）隐藏域（Hidden Field）

（2）Cookie

（3）URL重写

（4）HttpSession

我认为文章https://blog.youkuaiyun.com/lirx_tech/article/details/49586363介绍的比较清晰
...]]></description><category></category></item></channel></rss>