lfish001的博客

入坑Flink - Flink on Yarn提交任务异常 在通过 flink run -m yarn-cluster 提交任务过程中任务一直created 查看jobManager日志发现jar包冲突 2021-01-25 16:43:51,735 INFO org.apache.flink.yarn.YarnResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job

jar包冲突引起的… … Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/flink/runtime/state/StateBackend at org.apache.flink.streaming.api.scala.StreamExecutionEnvironment$.getExecutionEnv...

准备工作 参考官网： https://ci.apache.org/projects/flink/flink-docs-release-1.8/flinkDev/building.html 1、jdk java version "1.8.0_171" Java(TM) SE Runtime Environment (build 1.8.0_171-b11) Java HotSpot(TM) 64-B...

1、Flink单机模式 1、将编译后的包拷贝到安装目录 cp -r flink-dist/target/flink-1.8.2-bin/flink-1.8.2/ /opt/platform/ 2、改变文件所属 chown -R dc:dc flink-1.8.2 3、修改默认端口号（conf/flink-conf.yaml ） # The RPC port where the JobManag...

将flink脚本提交到Yarn集群有2种方式 1、Start a long-running Flink cluster on YARN 1、启动FlinkCluster： ./bin/yarn-session.sh -jm 1024m -tm 4096m 2、提交flink程序到FlinkCluster ./bin/flink run ./examples/batch/WordCount.jar ...