运维自动化之ansible playbook一键化安装mysql主从

POOPE

　　今天qq群里有朋友讨论使用ansible创建mysql主从的问题，正好我公司之前有需求，我就写了这个模块，现在分享给大家。
　　一、各软件版本

　　1、docker版本

Client version: 1.3.2
Client API version: 1.15
Go version (client): go1.3.3
Git commit (client): 39fa2fa/1.3.2
OS/Arch (client): linux/amd64
Server version: 1.3.2
Server API version: 1.15
Go version (server): go1.3.3
Git commit (server): 39fa2fa/1.3.2

　　2、docker存储

Containers: 2
Images: 4
Storage Driver: devicemapper
 Pool Name: docker-253:1-1430610-pool
 Pool Blocksize: 65.54 kB
 Data file: /var/lib/docker/devicemapper/devicemapper/data
 Metadata file: /var/lib/docker/devicemapper/devicemapper/metadata
 Data Space Used: 9.855 GB
 Data Space Total: 107.4 GB
 Metadata Space Used: 6.095 MB
 Metadata Space Total: 2.147 GB
 Library Version: 1.02.84-RHEL7 (2014-03-26)
Execution Driver: native-0.2
Kernel Version: 3.18.3-1.el7.elrepo.x86_64
Operating System: CentOS Linux 7 (Core)

　　二、docker方面
　　1、新建立2个容器test1（mysql master）与test2（mysql slave）

[root@docker-test3 ~]#  sh create_docker_container_use_static_ip.sh test1 docker.ops-chukong.com:5000/centos6-http:new /usr/bin/supervisord 10
{'Physics_ip':'10.10.17.3','Container_name':'test1','Container_ip':'172.16.1.2/24','Container_vlan':'10','Container_vlan_gateway':'172.16.1.1/24','Container_create':'2015-03-05 14:49:19','Container_status':'running'}
[root@docker-test3 ~]#  sh create_docker_container_use_static_ip.sh test2 docker.ops-chukong.com:5000/centos6-http:new /usr/bin/supervisord 10
{'Physics_ip':'10.10.17.3','Container_name':'test2','Container_ip':'172.16.1.3/24','Container_vlan':'10','Container_vlan_gateway':'172.16.1.1/24','Container_create':'2015-03-05 14:49:39','Container_status':'running'}
[root@docker-test3 ~]# docker ps -a
CONTAINER ID    IMAGE                      COMMAND        CREATED        STATUS        PORTS         NAMES
36b3b3643097    docker.ops-chukong.com:5000/centos6-http:new   "/usr/bin/supervisor   About a minute ago   Up About a minute             test2
90f8ffc29d41    docker.ops-chukong.com:5000/centos6-http:new   "/usr/bin/supervisor   About a minute ago   Up About a minute             test1

　　已经创建了2个实例，test1的ip是172.16.1.2，test2的ip是172.16.1.3
　　使用这个创建是使用了持久化固定ip原因，各位使用其他方式创建也可以。
　　宿主机的ip是10.10.17.3
　　三、ansible方面
　　1、添加路由
　　在ansible里添加一条到这个主机的路由，方便直接ansible对容器的ip进行部署mysql
　　

[root@puppet ansible]# route add -net 172.16.0.0 netmask 255.255.0.0 gw 10.10.17.3
ping那2个容器ip
[root@puppet ansible]# ping -c 2 172.16.1.2
PING 172.16.1.2 (172.16.1.2) 56(84) bytes of data.
64 bytes from 172.16.1.2: icmp_seq=1 ttl=63 time=0.846 ms
64 bytes from 172.16.1.2: icmp_seq=2 ttl=63 time=0.121 ms
--- 172.16.1.2 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.121/0.483/0.846/0.363 ms
You have mail in /var/spool/mail/root
[root@puppet ansible]# ping -c 2 172.16.1.3
PING 172.16.1.3 (172.16.1.3) 56(84) bytes of data.
64 bytes from 172.16.1.3: icmp_seq=1 ttl=63 time=0.672 ms
64 bytes from 172.16.1.3: icmp_seq=2 ttl=63 time=0.111 ms
--- 172.16.1.3 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.111/0.391/0.672/0.281 ms

　　可以看到通了，把这2个ip放到ansible的hosts里

　　2、添加hosts

[root@puppet ansible]# tail -n3 /etc/ansible/hosts
[container_mysql]
172.16.1.2:22
172.16.1.3:22

　　3、使用ansible部署mysql
　　A、部署mysql master，在test1节点部署

time ansible-playbook mysql_master_install.yml --extra-vars "host=172.16.1.2 user=root mysql_slave_ip=172.16.1.3"  -k

　　mysql_slave_ip是从库的ip，弄这个是在master里给slave进行账号授权
　　下面开始部署

root@puppet ansible]# time ansible-playbook mysql_master_install.yml --extra-vars "host=172.16.1.2 user=root mysql_slave_ip=172.16.1.3"  -k
SSH password:
PLAY [172.16.1.2] *************************************************************
GATHERING FACTS ***************************************************************
ok: [172.16.1.2]
TASK: [common | Install initializtion require software] ***********************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Software To Redhat Client] ***********
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql User In Redhat Client] *************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Start Script To Redhat Client] *******
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Install Mysql Script  To Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Config To Redhat Client] *************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Security Script To Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql Install Dir] ***********************
ok: [172.16.1.2]
TASK: [mysql_master_install | Uncompression Mysql Software To Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Modify Mysql Dir Permission In Redhat Client] ***
ok: [172.16.1.2] => (item=/data/mysql/datadir)
ok: [172.16.1.2] => (item=/data/mysql/basedir)
TASK: [mysql_master_install | Install Mysql Script In Redhat Client] **********
changed: [172.16.1.2]
TASK: [mysql_master_install | Wait Untils Mysql Service Avaiable In Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Start Myql Security Script In Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Add Boot Start Mysql Service In Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Create Slave Script To Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql Master And Slave  In redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Delete Create Mysql Master And Slave Script  In redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Delete Mysql compression Software In Redhat Client] ***
changed: [172.16.1.2]
PLAY RECAP ********************************************************************
172.16.1.2         : ok=19   changed=16   unreachable=0  failed=0

real3m2.646s
user0m14.250s
sys0m0.854s

　　可以看到3分钟部署完成，最浪费时间的是yum安装基础库
　　现在去test1里查看
　　

[root@puppet ansible]# ssh 172.16.1.2
root@172.16.1.2's password:
Last login: Mon Nov 17 14:10:39 2014 from 172.17.42.1
root@b8d17d0f3941:~
15:02:39 # netstat -tlnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address         Foreign Address       State     PID/Program name
tcp    0    0 172.16.1.2:3306       0.0.0.0:*           LISTEN    -
tcp    0    0 0.0.0.0:22          0.0.0.0:*           LISTEN    8/sshd
tcp    0    0 :::80             :::*            LISTEN    14/httpd
tcp    0    0 :::22             :::*            LISTEN    8/sshd
root@b8d17d0f3941:~
root@b8d17d0f3941:~
15:03:12 # mysql -h 172.16.1.2 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 12
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| performance_schema |
+--------------------+
3 rows in set (0.00 sec)
mysql> use mysql
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select host,user,password from user;
+------------+--------+-------------------------------------------+
| host     | user   | password                  |
+------------+--------+-------------------------------------------+
| localhost  | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| 172.16.1.3 | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| 172.16.1.2 | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| %      | zabbix | *DEEF4D7D88CD046ECA02A80393B7780A63E7E789 |
+------------+--------+-------------------------------------------+
4 rows in set (0.00 sec)
mysql>

　　可以看到数据库部署成功，并已经给予slave授予了权限。
　　B、部署从库
　　在test2节点部署

time ansible-playbook mysql_slave_install.yml --extra-vars "host=172.16.1.3 user=root mysql_master_ip=172.16.1.2 mysql_master_port=3306 mysql_master_user=root mysql_master_passwd=E4yR3WnoluSFTCBAI"  -k

　　mysql_master_ip是mysql master的ip
　　mysql_master_port是mysql master的mysql端口
　　mysql_master_user是mysql master的mysql用户
　　mysql_master_passwd是mysql 的密码
　　如果你使用我模块部署mysql的master了，直接运行命令就行，如果没有，只想单独弄个从库，主库不弄，那么第一步创建mysql master就不需要，只需要你在mater里授予slave的权限，然后运行mysql slave的模块就行
　　下面是运行情况
　　

[root@puppet ansible]# time ansible-playbook mysql_slave_install.yml --extra-vars "host=172.16.1.3 user=root mysql_master_ip=172.16.1.2 mysql_master_port=3306 mysql_master_user=root mysql_master_passwd=E4yR3WnoluSFTCBAI"  -k
SSH password:
PLAY [172.16.1.3] *************************************************************
GATHERING FACTS ***************************************************************
ok: [172.16.1.3]
TASK: [common | Install initializtion require software] ***********************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Software To Redhat Client] ************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql User In Redhat Client] **************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Start Script To Redhat Client] ********
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Install Mysql Script  To Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Config To Redhat Client] **************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Security Script To Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql Install Dir] ************************
ok: [172.16.1.3]
TASK: [mysql_slave_install | Uncompression Mysql Software To Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Modify Mysql Dir Permission In Redhat Client] ****
ok: [172.16.1.3] => (item=/data/mysql/datadir)
ok: [172.16.1.3] => (item=/data/mysql/basedir)
TASK: [mysql_slave_install | Install Mysql Script In Redhat Client] ***********
changed: [172.16.1.3]
TASK: [mysql_slave_install | Wait Untils Mysql Service Avaiable In Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Start Myql Security Script In Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Add Boot Start Mysql Service In Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Create Slave Script To Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql Master And Slave  In redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Delete Create Mysql Master And Slave Script  In redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Delete Mysql compression Software In Redhat Client] ***
changed: [172.16.1.3]
PLAY RECAP ********************************************************************
172.16.1.3         : ok=19   changed=16   unreachable=0  failed=0

real2m59.966s
user0m14.413s
sys0m0.987s

　　部署完成，下面测试一下

15:26:22 # netstat -tlnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address         Foreign Address       State     PID/Program name
tcp    0    0 172.16.1.3:3306       0.0.0.0:*           LISTEN    -
tcp    0    0 0.0.0.0:22          0.0.0.0:*           LISTEN    8/sshd
tcp    0    0 :::80             :::*            LISTEN    14/httpd
tcp    0    0 :::22             :::*            LISTEN    8/sshd
root@4ac2891ba3fd:~
15:26:27 # mysql -h 172.16.1.3 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 16
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| performance_schema |
+--------------------+
3 rows in set (0.01 sec)
mysql> show processlist;
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
| Id | User    | Host       | db   | Command | Time | State                                     | Info       | Rows_sent | Rows_examined | Rows_read |
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
| 11 | system user |          | NULL | Connect |  192 | Waiting for master to send event                      | NULL       |     0 |       0 |     1 |
| 12 | system user |          | NULL | Connect |  192 | Slave has read all relay log; waiting for the slave I/O thread to update it | NULL       |     0 |       0 |     1 |
| 14 | root    | 172.16.1.3:53445 | NULL | Query   |  0 | NULL                                    | show processlist |     0 |       0 |     4 |
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
3 rows in set (0.00 sec)
mysql> show slave status\G
*************************** 1. row ***************************
         Slave_IO_State: Waiting for master to send event
          Master_Host: 172.16.1.2
          Master_User: mysql_sync
          Master_Port: 3306
        Connect_Retry: 60
        Master_Log_File: mysql-bin.000003
      Read_Master_Log_Pos: 1663
         Relay_Log_File: mysql-relay-bin.000002
        Relay_Log_Pos: 253
    Relay_Master_Log_File: mysql-bin.000003
       Slave_IO_Running: Yes
      Slave_SQL_Running: Yes
        Replicate_Do_DB:
      Replicate_Ignore_DB:
       Replicate_Do_Table:
     Replicate_Ignore_Table:
    Replicate_Wild_Do_Table:
  Replicate_Wild_Ignore_Table:
           Last_Errno: 0
           Last_Error:
         Skip_Counter: 0
      Exec_Master_Log_Pos: 1663
        Relay_Log_Space: 409
        Until_Condition: None
         Until_Log_File:
        Until_Log_Pos: 0
       Master_SSL_Allowed: No
       Master_SSL_CA_File:
       Master_SSL_CA_Path:
        Master_SSL_Cert:
      Master_SSL_Cipher:
         Master_SSL_Key:
    Seconds_Behind_Master: 0
Master_SSL_Verify_Server_Cert: No
        Last_IO_Errno: 0
        Last_IO_Error:
         Last_SQL_Errno: 0
         Last_SQL_Error:
  Replicate_Ignore_Server_Ids:
       Master_Server_Id: 2
1 row in set (0.00 sec)

　　可以看到从库数据库创建成功，并且主从（sql与i这2个状态也是yes）创建成功。
　　C、测试主从状态
　　在master里创建一个数据库mysql_master，并创建表test插入数据

[root@puppet ansible]# ssh 172.16.1.2
root@172.16.1.2's password:
Last login: Thu Mar  5 15:02:39 2015 from 10.10.11.125
root@b8d17d0f3941:~
15:27:20 # mysql -h 172.16.1.2 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 17
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> create database mysql_master;
Query OK, 1 row affected (0.00 sec)
mysql> use mysql_master
Database changed
mysql> create table test(id int,name varchar(4));
Query OK, 0 rows affected (0.03 sec)
mysql> desc test;
+-------+------------+------+-----+---------+-------+
| Field | Type     | Null | Key | Default | Extra |
+-------+------------+------+-----+---------+-------+
| id  | int(11)  | YES  |   | NULL  |     |
| name  | varchar(4) | YES  |   | NULL  |     |
+-------+------------+------+-----+---------+-------+
2 rows in set (0.00 sec)
mysql> insert into test value(1,'test1');
Query OK, 1 row affected, 1 warning (0.00 sec)
mysql> insert into test value(2,'test2');
Query OK, 1 row affected, 1 warning (0.00 sec)
mysql> select * from test;
+------+------+
| id   | name |
+------+------+
|  1 | test |
|  2 | test |
+------+------+
2 rows in set (0.00 sec)

　　然后去从库里查看

[root@puppet ansible]# ssh 172.16.1.3
root@172.16.1.3's password:
Last login: Thu Mar  5 15:25:06 2015 from 10.10.11.125
root@4ac2891ba3fd:~
15:31:05 # mysql -h 172.16.1.3 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 17
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| mysql_master     |
| performance_schema |
+--------------------+
4 rows in set (0.00 sec)
mysql> use mysql_master
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> show tables;
+------------------------+
| Tables_in_mysql_master |
+------------------------+
| test           |
+------------------------+
1 row in set (0.00 sec)
mysql> select * from test;
+------+------+
| id   | name |
+------+------+
|  1 | test |
|  2 | test |
+------+------+
2 rows in set (0.00 sec)

　　可以看到从库也同步了数据，mysql主从创建成功。
　　四、模块地址
　　mysql master 地址

https://github.com/dl528888/ansible-examples/tree/master/mysql_master_install

　　mysql slave地址

https://github.com/dl528888/ansible-examples/tree/master/mysql_slave_install

[MySQL] 运维自动化之ansible playbook一键化安装mysql主从

相关帖子

MySQL Server 层和存储引擎层是怎么交互数据的？

MySQL让人又爱又恨的多表查询

MySQL存储过程图文实例讲解

MySQL由浅入深掌握连接查询

MySQL数据库触发器从小白到精通

一篇带给你MySQL索引知识详解

MySQL视图和索引专篇精讲

阿里面试MySQL死锁问题的处理

mysql中drop、truncate与delete的区别详析

Linux中如何排查网络？常见的网络排查指令都有哪些?

POOPE LV4