Flink-实战
分享
扫一扫
一起进步
优惠券已抵扣
余额抵扣
还需支付
¥39.90
¥99.00
购买须知?
本专栏为图文内容，最终完结不会低于15篇文章。
订阅专栏，享有专栏所有文章阅读权限。
本专栏为虚拟商品，基于网络商品和虚拟商品的性质和特征，专栏一经购买无正当理由不予退款，不支持升级，敬请谅解。
南修子
深圳大数据求坑~
展开
-
Flink 1.13: 进来的第一条数据属于哪个窗口
demo代码ingleOutputStreamOperator<Order> result = orderDSWithWatermark.keyBy(Order::getUserId) .window(TumblingEventTimeWindows.of(Time.seconds(5))) .sum("money");我们进入设断点到flink=》org.apache.flink.streaming.api.wind原创 2021-09-07 16:46:36 · 223 阅读 · 0 评论 -
Flink1.13：报错No ExecutorFactory found to execute the application.
错误如下：Exception in thread "main" java.lang.IllegalStateException: No ExecutorFactory found to execute the application. at org.apache.flink.core.execution.DefaultExecutorServiceLoader.getExecutorFactory(DefaultExecutorServiceLoader.java:88) at org.apac.原创 2021-09-07 13:45:39 · 1088 阅读 · 0 评论 -
flink错误：Field expressions are only supported on POJO types, tuples, and case classes
D:\SoftWareHome\java\bin\java.exe "-javaagent:D:\SoftWareHome\IntelliJ IDEA 2021.1.2\lib\idea_rt.jar=62554:D:\SoftWareHome\IntelliJ IDEA 2021.1.2\bin" -Dfile.encoding=UTF-8 -classpath D:\SoftWareHome\java\jre\lib\charsets.jar;D:\SoftWareHome\java\jre\lib\.原创 2021-09-07 11:38:29 · 766 阅读 · 0 评论 -
Flink1.12 API 读取并执行SQL文件，实现FLINKSQL SHELL功能
<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"&g原创 2021-07-30 16:11:06 · 939 阅读 · 0 评论 -
Flink1.12 API消费OGG推送的kafka写入Oracle
<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/mav原创 2021-07-30 16:04:28 · 883 阅读 · 0 评论 -
Flink 1.12同步kafka写clickhouse
**POM文件**<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache原创 2021-07-30 15:47:37 · 370 阅读 · 0 评论 -
SQL开窗函数学习（二）
SELECT id,P_DESC ,PRICE,ROW_NUMBER () over( ORDER BY PRICE ) AS ROW_NUMBER_ ,RANK () over( ORDER BY PRICE ) AS RANK_ ,DENSE_RANK () over( ORDER BY PRICE ) AS DENSE_RANK_ FROM TEST4 ORDER BY PRICE; IDP_DESCPRICEROW_NUMBER_RANK_DENSE_RA原创 2021-07-30 11:24:41 · 129 阅读 · 0 评论 -
SQL开窗函数学习（一）
开窗函数模式：分析函数（sum()…） over( [partition by xxx] order by xxx [desc] [ROWS BETWEEN xxx and xxx]) as xxxeg: SUM(price) OVER(partition by p_desc order by price)CREATE TABLE "TEST4" ( "ID" VARCHAR2(100), "P_DESC" VARCHAR2(100), "PRICE" NUMBER(2,0) )原创 2021-07-30 10:57:27 · 530 阅读 · 0 评论 -
Flinksql 读取kafka问题
一个线上flink1.12 sql 读取kafka源的发现，刚开始用这个东西，发现了就及时记录，建kafka表的时候，字段名字要和toplic里面的字段一致，大小写要保持一致，不然读不到数据，er原创 2021-06-03 14:27:14 · 981 阅读 · 0 评论 -
flink streaming eventtime watermark
import org.apache.flink.api.common.functions.MapFunction;import org.apache.flink.api.java.tuple.Tuple2;import org.apache.flink.streaming.api.TimeCharacteristic;import org.apache.flink.streaming.api.datastream.DataStream;import org.apache.flink.streami.原创 2020-06-20 17:00:48 · 161 阅读 · 0 评论 -
flink 1.10.1的三种部署模式
首先准备好家伙下载flink 1.10.1https://mirror.bit.edu.cn/apache/flink/flink-1.10.1/flink-1.10.1-bin-scala_2.11.tgz 下载jdkhttps://download.oracle.com/otn/java/jdk/8u202-b08/1961070e4c9b4e26a04e7f5a083f551e/jdk-8u202-linux-x64.tar.gzlocal模式 tar -zxvf flink-1.10原创 2020-06-20 14:59:56 · 1217 阅读 · 0 评论 -
flink 1.10.0 streaming consumer kafka test
pom 依赖<properties> <flink-version>1.10.0</flink-version> </properties> <dependencies> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-java</ar原创 2020-06-19 13:53:36 · 273 阅读 · 0 评论 -
flink1.8.2 on yarn 运行在jdk1.7环境上
要知道flink是建立在jdk1.8上面的，奈何集群环境的是1.7flink-conf.yaml追加三行env.java.home: /opt/jdk1.8.0_31containerized.master.env.JAVA_HOME: /opt/jdk1.8.0_31containerized.taskmanager.env.JAVA_HOME: /opt/jdk1.8.0_31...原创 2020-06-16 15:27:50 · 796 阅读 · 1 评论