gdolphinw的专栏

安装pyhive from pyhive import hive cursor=hive.connect("10.3.1.8",database="house").cursor() cursor.execute("show tables") for cur in cursor: print cur   import pandas as pd from pyhive import ...

fsck(file system check) ,用于检查HDFS上文件和目录的健康状态、获取文件的block块信息和位置信息等。 #hdfs dfs -ls /user/gewei/ #hdfs dfs -rm /user/gewei/houseApplyTest.csv hadoop fs -put houseApplyTest.csv hdfs:/user/gewei [dev@cd...

[dev@cdh1 python]$ vim genWordCount.py import random list =[] lineNum=0 with open("wordcount.txt","a") as w: for i in range(5000000): apply = random.randint(3, 10) word='' ...

HUE oozie创建Workflow和Scheduler 创建Workflow HUE查看Jobs 通过oozie查看jobs #oozie查看log信息 [dev@cdh1 oozie]$ oozie job -oozie http://cdh1:11000/oozie -info 0000063-190620162727859-oozie...

CDH 5 and Cloudera Manager 5 Requirements and Supported Versions 可以查看对JDK、数据库版本的要求 https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html https://blo...