hadoop跑数命令_csdn检查跑数问题-优快云博客

本文链接：https://blog.youkuaiyun.com/jtpython666/article/details/123877253

该博客内容涉及使用Hadoop文件系统（Hadoopfs）上传SQL脚本到用户目录，并通过shell脚本（etl_comm.sh）执行YARN上的ETL作业。作业包括债券、股票、期货、基金交易详情等初始化数据处理，涉及fahs和fa45两个项目目录。作业执行的日志被重定向到app3.log文件中。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

/home/ctmagent/etl_app/fahs/hql/dwd/trade/incre--hs�������ϴ�·��
/home/ctmagent/etl_app/fa45/hql/dwd/trade/incre--yss�������ϴ�·��
cd /home/ctmagent/etl_app/fahs/hql/dwd/trade/incre
cd /home/ctmagent/etl_app/fa45/hql/dwd/trade/incre
hadoop fs -put -f bond_trade_detail_init.sql /user/etl/fahs/dwd/
hadoop fs -put -f future_trade_detail_init.sql /user/etl/fahs/dwd/
hadoop fs -put -f financial_investment_trade_det_init.sql /user/etl/fahs/dwd/
hadoop fs -put -f stock_trade_detail_init.sql /user/etl/fahs/dwd/
hadoop fs -put -f fund_trade_detail_init.sql /user/etl/fahs/dwd/
hadoop fs -put -f stock_trade_detail_init.sql /user/etl/fa45/dwd/
hadoop fs -put -f fund_trade_detail_init.sql /user/etl/fa45/dwd/
hadoop fs -put -f bond_trade_detail_init.sql /user/etl/fa45/dwd/
--hadoop�ϴ�
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/future_trade_detail_init.sql--ͨ��shell���ýű�
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/stock_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/bond_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/future_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/fund_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fahs/dwd/financial_investment_trade_det_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fa45/dwd/stock_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fa45/dwd/fund_trade_detail_init.sql
sh ~/etl_app/comm/bin/etl_comm.sh /user/etl/fa45/dwd/bond_trade_detail_init.sql
yarn logs -applicationId application_1633244180597_12530 >./app3.log