Java大数据-DataX从stream流读取数据并打印到控制台

最新推荐文章于 2025-02-07 19:11:43 发布

godkzz

最新推荐文章于 2025-02-07 19:11:43 发布

阅读量1k

点赞数

分类专栏：大数据文章标签： java hive 开发语言

本文链接：https://blog.youkuaiyun.com/godkzz/article/details/122306013

版权

一、查看配置模板

[atguigu@hadoop102 bin]$ python datax.py -r streamreader -w streamwriter
DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
Please refer to the streamreader document:
 https://github.com/alibaba/DataX/blob/master/streamreader/doc/streamreader.md 
Please refer to the streamwriter document:
 https://github.com/alibaba/DataX/blob/master/streamwriter/doc/streamwriter.md 
Please save the following configuration as a json file and use
 python {DATAX_HOME}/bin/datax.py {JSON_FILE_NAME}.json 
to run the job.
{
 "job": {
 "content": [
 {
 "reader": {
 "name": "streamreader", 
 "parameter": {
 "column": [], 
 "sliceRecordCount": ""
 }
 }, 
 "writer": {
 "name": "streamwriter", 
 "parameter": {
 "encoding": "", 
 "print": true
 }
}
 }
 ], 
 "se