
编程模型及核心概念
flink从入门到实战 第3章 编程模型及核心概念
Pengsen Ma
这个作者很懒,什么都没留下…
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
python处理带有‘\x‘的字符串,拆分,解码,重组
原始字符\xaaU\x03\xa6\x00\x04\x00\x03\x01\x00\x01\x11HU\xaa1.按照\x分割aaU03a60004000301000111HUaa2.将所有的大写字母转为16进制aa5503a600040003010001114855aa3.将所有的小写字母转为大写字母AA5503A600040003010001114855AAmessage="\xaaU\x03\xa6\x00\x04\x00\x03\x01\x00\x01\x11HU\xaa原创 2020-12-02 14:27:51 · 25499 阅读 · 2 评论 -
Specifying Keys(指定key之tuple)
Specifying KeysSome transformations (join, coGroup, keyBy, groupBy) require that a key be defined on a collection of elements. Other transformations (Reduce, GroupReduce, Aggregate, Windows) allow data being grouped on a key before they are applied.A Dat原创 2020-08-31 20:44:47 · 9393 阅读 · 0 评论 -
Lazy Evaluation(延迟执行)
All Flink programs are executed lazily: When the program’s main method is executed, the data loading and transformations do not happen directly. Rather, each operation is created and added to the program’s plan. The operations are actually executed when th原创 2020-08-31 20:21:32 · 9512 阅读 · 0 评论 -
Anatomy of a Flink Program(Flink程序的剖析)
Flink program consists of the same basic parts:1.Obtain an execution environment,获取执行环境2.Load/create the initial data,获取数据3.Specify transformations on this data,指定数据转换4.Specify where to put the results of your computations,指定数据sink到哪里5.Trigger the pro原创 2020-08-31 11:15:46 · 9346 阅读 · 0 评论 -
DataSet and DataStream
Flink has the special classes DataSet and DataStream to represent data in a program. You can think of them as immutable(不可变的) collections of data that can contain duplicates(可以重复).In the case of DataSet the data is finite(对于DataSet 数据是有界的,批处理使用)while for原创 2020-08-31 10:30:27 · 9168 阅读 · 0 评论