PySpark Structured Streaming实时消费kafka数据写入MongoDB
KafkaProducer生产数据格式
向kafka发送数据的格式
{"u_id":"11629939865","timestamp":1622955136,"channel_id":"","detail":{"order_id":"6b3a5eb82a1a","goods_id":1004,"goods_name":"coin","amount":819}}
解析数据所对应的 schema
schema = T.StructType() \
.add("u_id", T.StringTy
原创
2021-08-27 16:48:36 ·
715 阅读 ·
0 评论