我思故我在

Hadoop入门简要学习指南(1)一、 什么是HadoopThe Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.(引自官网)Hadoop 是一个开源的，可靠的，可扩展的分布式计算软件。主要通过以下几个部分来阐述hadoop的学习思...

##spark.sql.SqlContext等包找不到##报错信息如下：百度了很多，没有找到原因，后在一朋友指导下修复了该问题解决方案修改pom，把依赖包的范围给注释掉然后reimport dependencies重新运行main示例，问题解决关于maven依赖范围的几点补充：scope:This element refers to the classpath of th...

Hadoop/Yarn/Hive/Spark等大数据环境搭建集成篇一、Hadoop环境搭建与配置1、前置准备，安装jdk和ssh免密登录参见https://blog.youkuaiyun.com/qq_29269907/article/details/812214302、下载hadoopwget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-...

spark-cdh版本编译过程中的各种坑** bug1 **[ERROR] Failed to execute goal on project spark-launcher_2.11: Could not resolve dependencies for project org.apache.spark:spark-launcher_2.11:jar:2.1.0: Could not fin...