gdolphinw的专栏

安装pyhivefrom pyhive import hivecursor=hive.connect("10.3.1.8",database="house").cursor()cursor.execute("show tables")for cur in cursor: print cur import pandas as pdfrom pyhive import ...

fsck(file system check) ,用于检查HDFS上文件和目录的健康状态、获取文件的block块信息和位置信息等。#hdfs dfs -ls /user/gewei/#hdfs dfs -rm /user/gewei/houseApplyTest.csvhadoop fs -put houseApplyTest.csv hdfs:/user/gewei[dev@cd...

[dev@cdh1 python]$ vim genWordCount.pyimport randomlist =[]lineNum=0with open("wordcount.txt","a") as w: for i in range(5000000): apply = random.randint(3, 10) word='' ...

HUE oozie创建Workflow和Scheduler创建WorkflowHUE查看Jobs通过oozie查看jobs#oozie查看log信息[dev@cdh1 oozie]$ oozie job -oozie http://cdh1:11000/oozie -info 0000063-190620162727859-oozie...

CDH 5 and Cloudera Manager 5 Requirements and Supported Versions可以查看对JDK、数据库版本的要求https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.htmlhttps://blo...