记录一下使用SpringBoot+Mybatis整合TDengine数据库和Mysql数据库的Demo,并且同时支持分页返回查询数据
在物联网的系统中,mysql存储物联网数据单表达到几千万条或者达到一亿多条数据后,根据时间来查询当日的某个设备数据会存在十分明显缓慢的问题,如果查询条件选择查询好几天好几个月的数据,那很明显直接卡死,甚至导致系统崩溃
例如某个传感器的数据
对该设备查询当日 大概是600多条

对该设备查询当月 大概15000条

对该设备查询一年多的数据 24万多条

看似这个设备的数据不多,如果放在mysql的表里,上千上万个设备呢?对于单表日志来说就不可能实现秒开
所以这类数据使用tdengine时序数据库最好不过,一个设备可以建立一张子表,或者一类设备建立一张子表,效率大大提升
但是有时候限制于成本考虑,mysql和tdengine仅仅部署在4核8G或者2核4G的服务器上,java的应用启动太多太占用内存了,最好的优化就是多数据源方式,mysql和tdengine同在一个jar里,这样查询倒也方便
先看效果
这是查询mysql数据库分页数据的接口返回

这是查询tdengine数据库日志数据的接口返回

记录下demo代码,实际就是参考这2篇文章整合而来:
SpringBoot+Mybatis整合TDengine数据库的Demo
SpringBoot+Mybatis整合Mysql数据库的Demo
首先是对mysql和tdengine创建对应的数据库和数据表信息,上面2篇文章里已经存在(并且有些类和对象也是存在的,下面的代码没有过多体现)
pom.xml
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<parent>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-parent</artifactId>
<version>2.0.5.RELEASE</version>
<relativePath/> <!-- lookup parent from repository -->
</parent>
<groupId>boot.example</groupId>
<artifactId>boot-example-mybatis-tdengine-mysql-2.0.5</artifactId>
<version>0.0.1-SNAPSHOT</version>
<name>boot-example-mybatis-tdengine-mysql-2.0.5</name>
<description>boot-example-mybatis-tdengine-mysql-2.0.5</description>
<dependencies>
<dependency>
<groupId>org.projectlombok</groupId>
<artifactId>lombok</artifactId>
<version>RELEASE</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
<dependency>
<groupId>org.mybatis.spring.boot</groupId>
<artifactId>mybatis-spring-boot-starter</artifactId>
</dependency>
<dependency>
<groupId>com.github.pagehelper</groupId>
<artifactId>pagehelper-spring-boot-starter</artifactId>
<version>1.4.1</version>
</dependency>
<dependency>
<groupId>com.taosdata.jdbc</groupId>
<artifactId>taos-jdbcdriver</artifactId>
<version>3.2.8</version>
</dependency>
<dependency>
<groupId>io.springfox</groupId>
<artifactId>springfox-swagger2</artifactId>
<version>2.9.2</version>
</dependency>
<dependency>
<groupId>com.github.xiaoymin</groupId>
<artifactId>swagger-bootstrap-ui</artifactId>
<version>1.9.2</version>
</dependency>
<dependency>
<groupId>org.mybatis.spring.boot</groupId>
<artifactId>mybatis-spring-boot-starter</artifactId>
<version>2.1.1</version>
</dependency>
<dependency>
<groupId>com.alibaba</groupId>
<artifactId>druid-spring-boot-starter</artifactId>
<version>1.1.17</version>
</dependency>
<dependency>
<groupId>mysql</groupId>
<artifactId>mysql-connector-java</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-test</artifactId>
<scope>test</scope>
<exclusions>
<exclusion>
<groupId>org.junit.vintage</groupId>
<artifactId>junit-vintage-engine</artifactId>
</exclusion>
</exclusions>
</dependency>
</dependencies>
<build>
<resources>
<resource>
<directory>src/main/resources</directory>
<includes>
<include>**/*.properties</include>
<include>**/*.yml</include>
<include>**/*.xml</include>
</includes>
<filtering>true</filtering>
</resource>
<resource>
<directory>src/main/java</directory>
<includes>
<include>**/*.properties</include>
<include>**/*.yml</include>
<include>**/*.xml</include>
</includes>
</resource>
</resources>
<plugins>
<plugin>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-maven-plugin</artifactId>
<version>2.5.8</version>
</plugin>
</plugins>
</build>
</project>
application.properties
server.port=8060
spring.application.name=boot-example-mybatis-demo
spring.datasource.mysql-server.type=com.zaxxer.hikari.HikariDataSource
#spring.datasource.mysql-server.type=com.alibaba.druid.pool.DruidDataSource
spring.datasource.mysql-server.driver-class-name=com.mysql.jdbc.Driver
spring.datasource.mysql-server.jdbc-url=jdbc:mysql://192.168.1.6:3306/boot_example?useUnicode=true&characterEncoding=utf-8&useSSL=false
spring.datasource.mysql-server.username=sysroot
spring.datasource.mysql-server.password=xdX.12345678
#spring.datasource.mysql-server.pool-name=mysqlData
#spring.datasource.mysql-server.minimum-idle=5
#spring.datasource.mysql-server.maximum-pool-size=10

最低0.47元/天 解锁文章
2332

被折叠的 条评论
为什么被折叠?



