C MySQL读写分离连接串_Mysql读写分离

本文介绍了MySQL读写分离的概念、好处以及如何通过MySQL Proxy实现读写分离。在读写分离的架构中,主库处理事务性查询,从库处理SELECT查询,以此分散服务器压力。文章详细阐述了读写分离的步骤,包括创建用户、配置主从服务器、启动MySQL Proxy等,最后通过实例展示了读写分离的效果,强调了正确配置参数的重要性。

一 什么是读写分离

MySQL Proxy最强大的一项功能是实现“读写分离(Read/Write Splitting)”。

基本的原理是让主数据库处理事务性查询,而从数据库处理SELECT查询。数据库复制被用来把事务性查询导致的变更同步到集群中的从数据库。

当然,主服务器也可以提供查询服务。使用读写分离最大的作用无非是缓解服务器压力。可以看下这张图:

51428634

7263e2fa044bf0c83b453067406fbfb4.png

二 读写分离的好处

1.增加冗余

2.增加了机器的处理能力

3.对于读操作为主的应用,使用读写分离是最好的场景,因为可以确保写的服务器压力更小,而读又可以接受点时间上的延迟。

三 读写分离提高性能之原因

1.物理服务器增加,负荷增加

2.主从只负责各自的写和读,极大程度的缓解X锁和S锁争用

3.从库可配置myisam引擎,提升查询性能以及节约系统开销

4.从库同步主库的数据和主库直接写还是有区别的,通过主库发送来的binlog恢复数据,但是,最重要区别在于主库向从库发送binlog是异步的,从库恢复数据也是异步的

5.读写分离适用与读远大于写的场景,如果只有一台服务器,当select很多时,update和delete会被这些select访问中的数据堵塞,等待select结束,并发性能不高。

对于写和读比例相近的应用,应该部署双主相互复制

6.可以在从库启动是增加一些参数来提高其读的性能,例如--skip-innodb、--skip-bdb、--low-priority-updates以及--delay-key-write=ALL。

当然这些设置也是需要根据具体业务需求来定得,不一定能用上

7.分摊读取。

假如我们有1主3从,不考虑上述1中提到的从库单方面设置,假设现在1分钟内有10条写入,150条读取。

那么,1主3从相当于共计40条写入,而读取总数没变,因此平均下来每台服务器承担了10条写入和50条读取(主库不承担读取操作)。

因此,虽然写入没变,但是读取大大分摊了,提高了系统性能。

另外,当读取被分摊后,又间接提高了写入的性能。所以,总体性能提高了,说白了就是拿机器和带宽换性能。

MySQL官方文档中有相关演算公式:官方文档 见6.9FAQ之“MySQL复制能够何时和多大程度提高系统性能”

8.MySQL复制另外一大功能是增加冗余,提高可用性,当一台数据库服务器宕机后能通过调整另外一台从库来以最快的速度恢复服务,

因此不能光看性能,也就是说1主1从也是可以的。

四 读写分离示意图

cd8c640e265646e73fa43b7a0a335a20.png

51428634

51428634

五 读写分离模拟

实验环境简介

serv01:代理服务器 192.168.1.11 serv01.host.com

serv08:主服务器(主要写数据,可读可写) 192.168.1.18 serv08.host.com

serv09:从服务器(主要读数据) 192.168.1.19 serv09.host.com

操作系统版本

RHEL Server6.1 64位系统

使用到的软件包版本

mysql-5.5.29-linux2.6-x86_64.tar.gz

mysql-proxy-0.8.2-linux-glibc2.3-x86-64bit.tar.gz

第一步,搭建MySQL服务器,清空日志。注意:代理服务器中不需要装MySQL

第二步,拷贝mysql-proxy-0.8.2-linux-glibc2.3-x86-64bit.tar.gz文件,解压文件

[root@larrywen 1005]# scp mysql-proxy-0.8.2-linux-glibc2.3-x86-64bit.tar.gz 192.168.1.11:/opt

[root@serv01 opt]# tar -xvf mysql-proxy-0.8.2-linux-glibc2.3-x86-64bit.tar.gz -C /usr/local/

[root@serv01 opt]# cd /usr/local/

[root@serv01 local]# mv mysql-proxy-0.8.2-linux-glibc2.3-x86-64bit/ mysql-proxy

[root@serv01 local]# ll mysql-proxy/

total 24

drwxr-xr-x. 2 7157 wheel 4096 Aug 17 2011 bin

drwxr-xr-x. 2 7157 wheel 4096 Aug 17 2011 include

drwxr-xr-x. 4 7157 wheel 4096 Aug 17 2011 lib

drwxr-xr-x. 2 7157 wheel 4096 Aug 17 2011 libexec

drwxr-xr-x. 3 7157 wheel 4096 Aug 17 2011 licenses

drwxr-xr-x. 3 7157 wheel 4096 Aug 17 2011 share

--可以查看帮助

[root@serv01 bin]# ./mysql-proxy --help-all

第三步,serv08主服务器创建用户,serv09从服务器创建用户,注意用户名和密码一致

serv08

mysql> grant all on *.* to 'larry'@'192.168.1.%' identified by 'larry';

Query OK, 0 rows affected (0.00 sec)

serv09

mysql> grant all on *.* to 'larry'@'192.168.1.%' identified by 'larry';

Query OK, 0 rows affected (0.00 sec)

第四步,serv09从服务器更改设置,开启slave,查看slave状态。创建测试数据库,插入测试数据

serv09

mysql> change master to master_host='192.168.1.18', master_user='larry', master_password='larry', master_port=3306, master_log_file='mysql-bin.000001', master_log_pos=107;

Query OK, 0 rows affected (0.01 sec)

mysql> start slave;

Query OK, 0 rows affected (0.00 sec)

mysql> show slave status \G;

*************************** 1. row ***************************

Slave_IO_State: Waiting for master to send event

Master_Host: 192.168.1.18

Master_User: larry

Master_Port: 3306

Connect_Retry: 60

Master_Log_File: mysql-bin.000001

Read_Master_Log_Pos: 107

Relay_Log_File: serv09-relay-bin.000002

Relay_Log_Pos: 253

Relay_Master_Log_File: mysql-bin.000001

Slave_IO_Running: Yes

Slave_SQL_Running: Yes

Replicate_Do_DB:

Replicate_Ignore_DB:

Replicate_Do_Table:

Replicate_Ignore_Table:

Replicate_Wild_Do_Table:

Replicate_Wild_Ignore_Table:

Last_Errno: 0

Last_Error:

Skip_Counter: 0

Exec_Master_Log_Pos: 107

Relay_Log_Space: 410

Until_Condition: None

Until_Log_File:

Until_Log_Pos: 0

Master_SSL_Allowed: No

Master_SSL_CA_File:

Master_SSL_CA_Path:

Master_SSL_Cert:

Master_SSL_Cipher:

Master_SSL_Key:

Seconds_Behind_Master: 0

Master_SSL_Verify_Server_Cert: No

Last_IO_Errno: 0

Last_IO_Error:

Last_SQL_Errno: 0

Last_SQL_Error:

Replicate_Ignore_Server_Ids:

Master_Server_Id: 2

1 row in set (0.00 sec)

ERROR:

No query specified

mysql> select user,password,host from mysql.user;

+------+-------------------------------------------+-----------------+

| user | password | host |

+------+-------------------------------------------+-----------------+

| root | | localhost |

| root | | serv08.host.com |

| root | | 127.0.0.1 |

| root | | ::1 |

| | | localhost |

| | | serv08.host.com |

| rep | *0CDC8D34246E22649D647DB04E7CCCACAB4368B6 | 192.168.1.% |

+------+-------------------------------------------+-----------------+

7 rows in set (0.00 sec)

mysql> create database larrydb;

Query OK, 1 row affected (0.00 sec)

mysql> use larrydb;

Database changed

mysql> create table user(id int, name varchar(30));

Query OK, 0 rows affected (0.01 sec)

mysql> insert into user values(1,'larrywen');

Query OK, 1 row affected (0.01 sec)

mysql> insert into user values(2,'wentasy');

Query OK, 1 row affected (0.00 sec)

mysql> select * from user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

+------+----------+

2 rows in set (0.00 sec)

serv09

mysql> select * from larrydb.user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

+------+----------+

2 rows in set (0.00 sec)

第五步,为了查看现象,serv09从服务器关闭slave

mysql> stop slave;

Query OK, 0 rows affected (0.01 sec)

第六步,serv 01查看是否有MySQL用户,修改rw-splitting.lua文件,修改如下几个参数

[root@serv01 mysql-proxy]# id mysql

uid=500(mysql) gid=500(mysql) groups=500(mysql)

[root@serv01 mysql-proxy]# vim rw-splitting.lua

[root@serv01 mysql-proxy]# cat rw-splitting.lua | grep -e min_idle_connections -e max_idle_connections -e is_debug

min_idle_connections = 1,--最小空闲连接数,为了测试,这里设置为1

max_idle_connections = 1,--最大空闲连接数,为了测试,这里设置为1

is_debug = true--是否打开Debug调试,为了查看调试信息,这里设置为true

第七步,启动mysql-proxy

[root@serv01 mysql-proxy]# /etc/init.d/mysql-proxy start

Starting mysql-proxy:

--先确定是否可以连接

[root@serv01 ~]# mysql -ularry -plarry -h 192.168.1.18

Welcome to the MySQL monitor. Commands end with ; or \g.

Your MySQL connection id is 6

Server version: 5.5.29-log Source distribution

Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> exit

Bye

[root@serv01 ~]# mysql -ularry -plarry -h 192.168.1.19

Welcome to the MySQL monitor. Commands end with ; or \g.

Your MySQL connection id is 8

Server version: 5.5.29-log Source distribution

Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> exit

Bye

第八步,查看现象

[root@serv01 ~]# /etc/init.d/mysql-proxy start

Starting mysql-proxy:

[root@serv01 ~]# mysql -ularry -plarry -h 192.168.1.11

[connect_server] 192.168.1.11:51054

[1].connected_clients = 0

[1].pool.cur_idle = 0

[1].pool.max_idle = 1

[1].pool.min_idle = 1

[1].type = 1

[1].state = 0

[1] idle-conns below min-idle

Welcome to the MySQL monitor. Commands end with ; or \g.

[read_query] 192.168.1.11:51054

current backend = 0

client default db =

client username = larry

query = select @@version_comment limit 1

sending to backend : 192.168.1.19:3306

is_slave : false

server default db:

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

Your MySQL connection id is 10

Server version: 5.5.29-log Source distribution

Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql>

mysql> use larrydb;

[read_query] 192.168.1.11:51054

current backend = 0

client default db =

client username = larry

query = SELECT DATABASE()

sending to backend : 192.168.1.19:3306

is_slave : false

server default db:

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

[read_query] 192.168.1.11:51054

current backend = 0

client default db =

client username = larry

sending to backend : 192.168.1.19:3306

is_slave : false

server default db:

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : false

Database changed

mysql> select * from user;

[read_query] 192.168.1.11:51054

current backend = 0

client default db = larrydb

client username = larry

query = select * from user

sending to backend : 192.168.1.19:3306

is_slave : false

server default db: larrydb

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

+------+----------+

2 rows in set (0.00 sec)

mysql> insert into user values(3,'jsutdb');

[read_query] 192.168.1.11:51644

current backend = 0

client default db = larrydb

client username = larry

query = insert into user values(3,'jsutdb')

sending to backend : 192.168.1.19:3306

is_slave : false

server default db: larrydb

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

Query OK, 1 row affected (0.00 sec)

serv08

mysql> select * from user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

+------+----------+

2 rows in set (0.00 sec)

serv09

mysql> select * from larrydb.user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

| 3 | jsutdb |

+------+----------+

3 rows in set (0.00 sec)

第九步,以上的测试虽有效果,但不是预期。排查原因,重新配置。发现proxy-read-only-backend-addresses和proxy-backend-addresses参数配置出错,proxy-read-only-backend-addresses应该配置成从服务器的IP地址,proxy-backend-addresses应该配置成主服务器的IP地址。

[root@serv01 ~]# vim /etc/init.d/mysql-proxy

[root@serv01 ~]# cat /etc/init.d/mysql-proxy

#!/bin/sh

#

# mysql-proxy This script starts and stops the mysql-proxy daemon

#

# chkconfig: - 78 30

# processname: mysql-proxy

# description: mysql-proxy is a proxy daemon to mysql

# Source function library.

. /etc/rc.d/init.d/functions

#PROXY_PATH=/usr/local/bin

PROXY_PATH=/usr/local/mysql-proxy/bin

prog="mysql-proxy"

# Source networking configuration.

. /etc/sysconfig/network

# Check that networking is up.

[ ${NETWORKING} = "no" ] && exit 0

# Set default mysql-proxy configuration.

#PROXY_OPTIONS="--daemon"

PROXY_OPTIONS="--proxy-read-only-backend-addresses=192.168.1.19:3306 --proxy-backend-addresses=192.168.1.18:3306 --proxy-lua-script=/usr/local/mysql-proxy/share/doc/mysql-proxy/rw-splitting.lua"

#PROXY_PID=/usr/local/mysql-proxy/run/mysql-proxy.pid

PROXY_PID=/var/run/mysql-proxy.pid

# Source mysql-proxy configuration.

if [ -f /etc/sysconfig/mysql-proxy ]; then

. /etc/sysconfig/mysql-proxy

fi

PATH=$PATH:/usr/bin:/usr/local/bin:$PROXY_PATH

# By default it's all good

RETVAL=0

# See how we were called.

case "$1" in

start)

# Start daemon.

echo -n $"Starting $prog: "

$NICELEVEL $PROXY_PATH/mysql-proxy $PROXY_OPTIONS --daemon --pid-file=$PROXY_PID --user=mysql --log-level=debug --log-file=/var/log/mysql-proxy.log --proxy-address=192.168.1.11:3306

RETVAL=$?

echo

if [ $RETVAL = 0 ]; then

touch /var/lock/subsys/mysql-proxy

fi

;;

stop)

# Stop daemons.

echo -n $"Stopping $prog: "

killproc $prog

RETVAL=$?

echo

if [ $RETVAL = 0 ]; then

rm -f /var/lock/subsys/mysql-proxy

rm -f $PROXY_PID

fi

;;

restart)

$0 stop

sleep 3

$0 start

;;

condrestart)

[ -e /var/lock/subsys/mysql-proxy ] && $0 restart

;;

status)

status mysql-proxy

RETVAL=$?

;;

*)

echo "Usage: $0 {start|stop|restart|status|condrestart}"

RETVAL=1

;;

esac

exit $RETVAL

第十步,测试。插入数据,可以发现连接的是主服务器,查询的时候也是主服务器。说明主服务器和从服务器均有读的的功能。

[root@serv01 ~]# mysql -ularry -plarry -h 192.168.1.11

[connect_server] 192.168.1.11:57891

[1].connected_clients = 0

[1].pool.cur_idle = 0

[1].pool.max_idle = 1

[1].pool.min_idle = 1

[1].type = 1

[1].state = 1

[1] idle-conns below min-idle

[read_query] 192.168.1.11:57891

current backend = 0

client default db =

client username = larry

query = select @@version_comment limit 1

sending to backend : 192.168.1.18:3306

is_slave : false

server default db:

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

mysql> insert into user values(5,'test');

Query OK, 1 row affected (0.01 sec)

[read_query] 192.168.1.11:57893

current backend = 0

client default db = larrydb

client username = larry

query = insert into user values(5,'test')

sending to backend : 192.168.1.18:3306

is_slave : false

server default db: larrydb

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

mysql> select * from user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

| 5 | test |

+------+----------+

3 rows in set (0.00 sec)

[read_query] 192.168.1.11:57893

current backend = 0

client default db = larrydb

client username = larry

query = select * from user

sending to backend : 192.168.1.18:3306

is_slave : false

server default db: larrydb

server username : larry

in_trans : false

in_calc_found : false

COM_QUERY : true

serv08主服务器查看数据,可以查询到,说明主服务器可以写

mysql> select * from larrydb.user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

| 5 | test |

+------+----------+

3 rows in set (0.00 sec)

serv09从服务器查询数据,发现不可查询到,说明从服务器只读

mysql> mysql> select * from larrydb.user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

| 3 | jsutdb |

| 4 | db |

+------+----------+

4 rows in set (0.00 sec)

第十一步,开启slave。发现数据同步成功。

mysql> start slave;

Query OK, 0 rows affected (0.00 sec)

mysql> select * from larrydb.user;

+------+----------+

| id | name |

+------+----------+

| 1 | larrywen |

| 2 | wentasy |

| 3 | jsutdb |

| 4 | db |

| 5 | test |

+------+----------+

5 rows in set (0.00 sec)

六 参考资料

MySQL中concat函数 使用方法: CONCAT(str1,str2,…) 返回结果为连接参数产生的字符。如有任何一个参数为NULL ,则返回值为 NULL。 注意: 如果所有参数均为非二进制字符,则结果为非二进制字符。 如果自变量中含有任一二进制字符,则结果为一个二进制字符。 一个数字参数被转化为与之相等的二进制字符格式;若要避免这种情况,可使用显式类型 cast, 例如: SELECT CONCAT(CAST(int_col AS CHAR), char_col) MySQL的concat函数可以连接一个或者多个字符,如 mysql> select concat('10'); +--------------+ | concat('10') | +--------------+ | 10 | +--------------+ 1 row in set (0.00 sec) mysql> select concat('11','22','33'); +------------------------+ | concat('11','22','33') | +------------------------+ | 112233 | +------------------------+ 1 row in set (0.00 sec) MySQL的concat函数在连接字符的时候,只要其中一个是NULL,那么将返回NULL mysql> select concat('11','22',null); +------------------------+ | concat('11','22',null) | +------------------------+ | NULL | +------------------------+ 1 row in set (0.00 sec) MySQL中concat_ws函数 使用方法: CONCAT_WS(separator,str1,str2,...) CONCAT_WS() 代表 CONCAT With Separator ,是CONCAT()的特殊形式。第一个参数是其它参数的分隔符。分隔符的位置放在要连接的两个字符之间。分隔符可以是一个字符,也可以是其它参数。 注意: 如果分隔符为 NULL,则结果为 NULL。函数会忽略任何分隔符参数后的 NULL 值。 如连接后以逗号分隔 mysql> select concat_ws(',','11','22','33'); +-------------------------------+ | concat_ws(',','11','22','33') | +-------------------------------+ | 11,22,33 | +-------------------------------+ 1 row in set (0.00 sec) 和MySQL中concat函数不同的是, concat_ws函数在执行的时候,不会因为NULL值而返回NULL mysql> select concat_ws(',','11','22',NULL); +-------------------------------+ | concat_ws(',','11','22',NULL) | +-------------------------------+ | 11,22 | +-------------------------------+ 1 row in set (0.00 sec) MySQL中group_concat函数 完整的语法如下: group_concat([DISTINCT] 要连接的字段 [Order BY ASC/DESC 排序字段] [Separator '分隔符']) 基本查询 mysql> select * from aa; +------+------+ | id| name | +------+------+ |1 | 10| |1 | 20| |1 | 20| |2 | 20| |3 | 200 | |3 | 500 | +------+------+ 6 rows in set (0.00 sec) 以id分组,把name字段的值打印在一行,逗号分隔(默认) mysql> select id,group_concat(name) from aa group by id; +------+--------------------+ | id| group_concat(name) | +------+--------------------+ |1 | 10,20,20| |2 | 20 | |3 | 200,500| +------+--------------------+ 3 rows in set (0.00 sec) 以id分组,把name字段的值打印在一行,分号分隔 mysql> select id,group_concat(name separator ';') from aa group by id; +------+----------------------------------+ | id| group_concat(name separator ';') | +------+----------------------------------+ |1 | 10;20;20 | |2 | 20| |3 | 200;500 | +------+----------------------------------+ 3 rows in set (0.00 sec) 以id分组,把去冗余的name字段的值打印在一行, 逗号分隔 mysql> select id,group_concat(distinct name) from aa group by id; +------+-----------------------------+ | id| group_concat(distinct name) | +------+-----------------------------+ |1 | 10,20| |2 | 20 | |3 | 200,500 | +------+-----------------------------+ 3 rows in set (0.00 sec) 以id分组,把name字段的值打印在一行,逗号分隔,以name排倒序 mysql> select id,group_concat(name order by name desc) from aa group by id; +------+---------------------------------------+ | id| group_concat(name order by name desc) | +------+---------------------------------------+ |1 | 20,20,10 | |2 | 20| |3 | 500,200| +------+---------------------------------------+ 3 rows in set (0.00 sec) repeat()函数 用来复制字符,如下'ab'表示要复制的字符,2表示复制的份数 mysql> select repeat('ab',2); +----------------+ | repeat('ab',2) | +----------------+ | abab | +----------------+ 1 row in set (0.00 sec) 又如 mysql> select repeat('a',2); +---------------+ | repeat('a',2) | +---------------+ | aa | +---------------+ 1 row in set (0.00 sec) mysql向表中某字段后追加一段字符: update table_name set field=CONCAT(field,'',str) mysql 向表中某字段前加字符 update table_name set field=CONCAT('str',field) 这个函数对你也许会有很大帮助哦!!
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值