qq_18239343的博客

【hive】集群外访问hive所需开通的端口

1、环境安装：使用cmd安装hdfs环境，pip installhdfs2、访问hdfs：from hdfs.client import ClientHDFSHOST = "http://192.168.56.101:9870"client = Client(HDFSHOST)# 返回目录下的文件#print(client.list('/wm/'))# 创建目录#client.makedirs('/tmp')#print(client.list('/'))# 删除hdfs文件.

1、以表为单位，查询每个表具有什么权限select s.*,(select tbl_name from tbls where tbl_id=s.tbl_id) tbl_name,(select name from dbs where db_id=(select db_id from tbls where tbl_id=s.tbl_id)) db_name from (select principal_name,principal_type,tbl_id,string_agg(tbl_priv,',')

Call From master/192.168.56.101 to master:9000 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefuse

查询数据 初始化环境 source /opt/poc_client/bigdata_env source /opt/poc_client/Hudi/component_env 启动客户端 spark-shell --master yarn --driver-memory 20g --driver-cores 4 --executor-memory 12g --executor-cores 4 --num-executors 50 --conf spark.executor....

删除hdfs指定目录三天前的文件hadoop fs -rm -r /meteobasicbd/null/*$(date -d -3day +%Y%m%d%H)*