晴空的博客

flink运行一切顺利，在发送数据量快达到1G的时候，突然发生故障，无故重启，最终导致整个flink程序崩溃。发现问题后，就开始测试，追踪到日志，如下：AsynchronousException{java.lang.Exception: Could not materialize checkpoint 1143 for operator logData -> Sink: host

package testMaven.testMaven;import org.apache.flink.streaming.api.datastream.DataStream;import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;import org.apache.flink.streami

前期准备，java运行环境准备8u144版本jdk：jdk-8u144-linux-x64.rpm多次从官网下载该rpm包失败，因此需要自己下载好该安装包#!/bin/bash################ 准备java环境 ######################DOWNLOAD_PATH=""JDK_PATH="jdk1.8.0_144" # "jre1....

#!/bin/sh########## HELP ###########if [ $# -ne 0 ];then if [ $1 == "-h" -o $1 == "-help" ];then echo -e " 示例： ./kafka.sh # 启动本地模式，不修改任何配置 ...

#!/bin/shINSTALL_PATH="/usr/local/src/";ZOOKEEPER_VERSION="3.4.11"ZOOKEEPER_GZIP="zookeeper-${ZOOKEEPER_VERSION}.tar.gz";ZOOKEEPER_CONF_DIR="${INSTALL_PATH}/zookeeper-${ZOOKEEPER_VERSION}/conf"Z...

以端口名(7001,7002,7003,7004,7005,7006)新建文件夹，存放集群节点的配置文件cd /usr/local/src/redis-4.0.2/mkdir -p ./cluster/7001 # 同理新建其他目录cp ./redis.conf ./cluster/7001 vi ./cluster/7001 # 打开修改配置文件要修改的配置内容po

#!/bin/sh########## HELP ###########if [ $# -ne 0 ];then if [ $1 == "-h" -o $1 == "-help" ];then echo -e " 示例： ./test # 启动本地模式，不修改任何配置 ...