把Nifi1.9所有与SQL有关的Processor使用一次,构建不同的dataflow,然后再去比较复用性和效率。
1.多表连接后查询(使用sql片段)—>DB
1.1 需求:将多张table的data迁移到另一张表
1.2 DataFlow
1.3 Configue
AvroReader
2.多表连接后查询(sql整句)后—>DB
2.1 需求:同1.1
略
2.2 DataFlow
2.3 Configure
Executes provided SQL select query. Query result will be converted to Avro format. Streaming is used so arbitrarily large result sets are supported.
3.多个表分别查询的结果—>DB
3.1 需求:
3.2 DataFlow
Funnel:Funnels are used to combine the data from
many Connections into a single Connection. Connections can be configured with FlowFile Prioritizers.
Data from several Connections can be funneled into a single Connection,
providing the ability to Prioritize all of the data on that one Connection,
rather than prioritizing the data on each Connection independently.
3.3 Configure
略,同1.3 的QDT
4.同一个数据库不同schema批量生成多张表
4.1 需求:无需提前在DB建表,利用Processor建表
4.2 DtafFlow
ListDatabaseTables: Generates a set of flow files, each containing attributes corresponding to metadata about a table from a database connection. GenerateTableFetch:Generates SQL select queries that fetch “pages” of rows from a table.
4.3 Configure
5.补充
以上是在同一个DB不同的table,不同DB只需配置不同的JDBC即可