WuBoooo的博客

实测解决 flink cdc mysql 时间字段差8小时/差13小时问题

--所有索引列表SELECT n.nspname as "Schema", c.relname as "Name", c2.relname as "Table"FROM pg_catalog.pg_class c JOIN pg_catalog.pg_roles r ON r.oid = c.relowner LEFT JOIN pg_catalog.pg_namespace n ON n.oid = c.relnamespace LEFT JOIN

//timeStamp = 2022-02-16T12:27:20.828524Z String zonedDateTime = LocalDateTime.parse(timeStamp.replace("Z", "")) .atZone(ZoneId.of("UTC"))//设置老时区 .withZoneSameInstant(ZoneId.of("Asia/Shanghai"))//设置新时区

自定义带超时时间的计数窗口触发器import org.apache.flink.api.common.functions.ReduceFunction;import org.apache.flink.api.common.state.ReducingState;import org.apache.flink.api.common.state.ReducingStateDescriptor;import org.apache.flink.api.common.typeutils.base.LongSe

该sql当id=1的数据已存在时，就不会插入数据，如果不存在就正常插入INSERT INTO ods.ods_iot_project(id, project_id, status) SELECT 1,456,456 FROM (SELECT 1) tmp WHERE NOT EXISTS ( SELECT 1 FROM ods.ods_iot_project WHERE id=1 );...

获得gp的数据库连接池，使用连接池，不要使用单连接package com.ysservice.dataStreamApi.utils;import com.alibaba.druid.pool.DruidDataSourceFactory;import javax.sql.DataSource;import java.sql.Connection;import java.sql.SQLException;import java.util.Properties;/** * @Descripti

package com.ysservice.dataStreamApi.sink;import com.ysservice.dataStreamApi.utils.GreenplumUtil;import com.ysservice.dataStreamApi.utils.RegexUtils;import org.apache.flink.api.common.state.CheckpointListener;import org.apache.flink.api.java.tuple.Tupl

flink cdc sql 开发模板flink cdc sql 读mysql的binlog日志，实时同步到mysql开发模板使用flink cdc前提条件：读取目标库的用户必须开启binlog权限package com.ysservice; import com.typesafe.config.Config;import com.typesafe.config.ConfigFactory;import com.ysservice.utils.MyCheckpoint;import com.

package com.ysservice.streaming.source;import com.alibaba.ververica.cdc.debezium.DebeziumDeserializationSchema;import com.ysservice.streaming.utils.MysqlUtil;import com.ysservice.streaming.utils.SystemConstants;import io.debezium.data.Envelope;import

Table aggVin = inputTable.window(Over.partitionBy("vin").orderBy("rt").preceding("1.rows").as("w")) .select("vin,rt,carTime,min(carTime) over w as min_carTime") .select("vin,rt,carTime,min_carTime,(carTime - min_carT...