https://blog.youkuaiyun.com/Full_Stack_delpzh-cnhttps://blog.youkuaiyun.com/https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612789https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612789Full_Stack_delpMon, 19 Mar 2018 15:51:19 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612411https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612411Full_Stack_delpMon, 19 Mar 2018 15:31:24 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612033https://blog.youkuaiyun.com/Full_Stack_delp/article/details/79612033Full_Stack_delpMon, 19 Mar 2018 15:12:14 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/76588573https://blog.youkuaiyun.com/Full_Stack_delp/article/details/76588573Full_Stack_delpWed, 02 Aug 2017 17:30:41 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72973067https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72973067Full_Stack_delpSat, 10 Jun 2017 00:12:22 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72973042https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72973042Full_Stack_delpSat, 10 Jun 2017 00:03:08 +0800 HDFS -> MR/Hive/Spark(相当于ETL) -> HDFS Parquet -> SparkSQL/impala -> Result Service(可以放在DB中，也有可能被通过JDBC/ODBC来作为数据服务使用)；B]]>https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72972934https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72972934Full_Stack_delpFri, 09 Jun 2017 23:34:20 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72972258https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72972258Full_Stack_delpFri, 09 Jun 2017 21:47:29 +0800 提前已经知道了RDD具体数据的元数据信息，可以通过JavaBean或Case Class的方式提前创建DataFrame时，通过反射的方式获得元数据信息。什么是动态转换？=> 无法提前知道具体的RDD每个Record的列的个数及每列的类型只有在运行时才能知道。这种情况在生产环境下更常见。因为在生产环境下提前知道数据的元数据信息的可能性不大。另外，生产环境下业务会变化，业务变化]]>https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72965139https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72965139Full_Stack_delpFri, 09 Jun 2017 17:05:28 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72951806https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72951806Full_Stack_delpFri, 09 Jun 2017 02:07:31 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72942932https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72942932Full_Stack_delpThu, 08 Jun 2017 23:19:32 +0800 hive.m]]>https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72917890https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72917890Full_Stack_delpThu, 08 Jun 2017 14:52:36 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72917856https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72917856Full_Stack_delpThu, 08 Jun 2017 14:49:16 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72878236https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72878236Full_Stack_delpTue, 06 Jun 2017 14:49:08 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877963https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877963Full_Stack_delpTue, 06 Jun 2017 14:33:05 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877892https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877892Full_Stack_delpTue, 06 Jun 2017 14:27:44 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877792https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877792Full_Stack_delpTue, 06 Jun 2017 14:20:32 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877617https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877617Full_Stack_delpTue, 06 Jun 2017 14:05:45 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877597https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72877597Full_Stack_delpTue, 06 Jun 2017 14:04:15 +0800https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72873597https://blog.youkuaiyun.com/Full_Stack_delp/article/details/72873597Full_Stack_delpTue, 06 Jun 2017 01:08:19 +0800