评论

收藏

[MySQL] 运维自动化之ansible playbook一键化安装mysql主从

数据库 数据库 发布于:2021-07-03 21:46 | 阅读数:547 | 评论:0

  今天qq群里有朋友讨论使用ansible创建mysql主从的问题,正好我公司之前有需求,我就写了这个模块,现在分享给大家。
  一、各软件版本

  1、docker版本
Client version: 1.3.2
Client API version: 1.15
Go version (client): go1.3.3
Git commit (client): 39fa2fa/1.3.2
OS/Arch (client): linux/amd64
Server version: 1.3.2
Server API version: 1.15
Go version (server): go1.3.3
Git commit (server): 39fa2fa/1.3.2
  2、docker存储
Containers: 2
Images: 4
Storage Driver: devicemapper
 Pool Name: docker-253:1-1430610-pool
 Pool Blocksize: 65.54 kB
 Data file: /var/lib/docker/devicemapper/devicemapper/data
 Metadata file: /var/lib/docker/devicemapper/devicemapper/metadata
 Data Space Used: 9.855 GB
 Data Space Total: 107.4 GB
 Metadata Space Used: 6.095 MB
 Metadata Space Total: 2.147 GB
 Library Version: 1.02.84-RHEL7 (2014-03-26)
Execution Driver: native-0.2
Kernel Version: 3.18.3-1.el7.elrepo.x86_64
Operating System: CentOS Linux 7 (Core)
  二、docker方面
  1、新建立2个容器test1(mysql master)与test2(mysql slave)
[root@docker-test3 ~]#  sh create_docker_container_use_static_ip.sh test1 docker.ops-chukong.com:5000/centos6-http:new /usr/bin/supervisord 10
{'Physics_ip':'10.10.17.3','Container_name':'test1','Container_ip':'172.16.1.2/24','Container_vlan':'10','Container_vlan_gateway':'172.16.1.1/24','Container_create':'2015-03-05 14:49:19','Container_status':'running'}
[root@docker-test3 ~]#  sh create_docker_container_use_static_ip.sh test2 docker.ops-chukong.com:5000/centos6-http:new /usr/bin/supervisord 10
{'Physics_ip':'10.10.17.3','Container_name':'test2','Container_ip':'172.16.1.3/24','Container_vlan':'10','Container_vlan_gateway':'172.16.1.1/24','Container_create':'2015-03-05 14:49:39','Container_status':'running'}
[root@docker-test3 ~]# docker ps -a
CONTAINER ID    IMAGE                      COMMAND        CREATED        STATUS        PORTS         NAMES
36b3b3643097    docker.ops-chukong.com:5000/centos6-http:new   "/usr/bin/supervisor   About a minute ago   Up About a minute             test2
90f8ffc29d41    docker.ops-chukong.com:5000/centos6-http:new   "/usr/bin/supervisor   About a minute ago   Up About a minute             test1
  已经创建了2个实例,test1的ip是172.16.1.2,test2的ip是172.16.1.3
  使用这个创建是使用了持久化固定ip原因,各位使用其他方式创建也可以。
  宿主机的ip是10.10.17.3
  三、ansible方面
  1、添加路由
  在ansible里添加一条到这个主机的路由,方便直接ansible对容器的ip进行部署mysql
  
[root@puppet ansible]# route add -net 172.16.0.0 netmask 255.255.0.0 gw 10.10.17.3
ping那2个容器ip
[root@puppet ansible]# ping -c 2 172.16.1.2
PING 172.16.1.2 (172.16.1.2) 56(84) bytes of data.
64 bytes from 172.16.1.2: icmp_seq=1 ttl=63 time=0.846 ms
64 bytes from 172.16.1.2: icmp_seq=2 ttl=63 time=0.121 ms
--- 172.16.1.2 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 0.121/0.483/0.846/0.363 ms
You have mail in /var/spool/mail/root
[root@puppet ansible]# ping -c 2 172.16.1.3
PING 172.16.1.3 (172.16.1.3) 56(84) bytes of data.
64 bytes from 172.16.1.3: icmp_seq=1 ttl=63 time=0.672 ms
64 bytes from 172.16.1.3: icmp_seq=2 ttl=63 time=0.111 ms
--- 172.16.1.3 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.111/0.391/0.672/0.281 ms
  可以看到通了,把这2个ip放到ansible的hosts里

  2、添加hosts
[root@puppet ansible]# tail -n3 /etc/ansible/hosts
[container_mysql]
172.16.1.2:22
172.16.1.3:22
  3、使用ansible部署mysql
  A、部署mysql master,在test1节点部署
time ansible-playbook mysql_master_install.yml --extra-vars "host=172.16.1.2 user=root mysql_slave_ip=172.16.1.3"  -k
  mysql_slave_ip是从库的ip,弄这个是在master里给slave进行账号授权
  下面开始部署
root@puppet ansible]# time ansible-playbook mysql_master_install.yml --extra-vars "host=172.16.1.2 user=root mysql_slave_ip=172.16.1.3"  -k
SSH password:
PLAY [172.16.1.2] *************************************************************
GATHERING FACTS ***************************************************************
ok: [172.16.1.2]
TASK: [common | Install initializtion require software] ***********************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Software To Redhat Client] ***********
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql User In Redhat Client] *************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Start Script To Redhat Client] *******
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Install Mysql Script  To Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Config To Redhat Client] *************
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Security Script To Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql Install Dir] ***********************
ok: [172.16.1.2]
TASK: [mysql_master_install | Uncompression Mysql Software To Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Modify Mysql Dir Permission In Redhat Client] ***
ok: [172.16.1.2] => (item=/data/mysql/datadir)
ok: [172.16.1.2] => (item=/data/mysql/basedir)
TASK: [mysql_master_install | Install Mysql Script In Redhat Client] **********
changed: [172.16.1.2]
TASK: [mysql_master_install | Wait Untils Mysql Service Avaiable In Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Start Myql Security Script In Redhat Client] ****
changed: [172.16.1.2]
TASK: [mysql_master_install | Add Boot Start Mysql Service In Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Copy Mysql Create Slave Script To Redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Create Mysql Master And Slave  In redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Delete Create Mysql Master And Slave Script  In redhat Client] ***
changed: [172.16.1.2]
TASK: [mysql_master_install | Delete Mysql compression Software In Redhat Client] ***
changed: [172.16.1.2]
PLAY RECAP ********************************************************************
172.16.1.2         : ok=19   changed=16   unreachable=0  failed=0

real3m2.646s
user0m14.250s
sys0m0.854s
  可以看到3分钟部署完成,最浪费时间的是yum安装基础库
  现在去test1里查看
  
[root@puppet ansible]# ssh 172.16.1.2
root@172.16.1.2's password:
Last login: Mon Nov 17 14:10:39 2014 from 172.17.42.1
root@b8d17d0f3941:~
15:02:39 # netstat -tlnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address         Foreign Address       State     PID/Program name
tcp    0    0 172.16.1.2:3306       0.0.0.0:*           LISTEN    -
tcp    0    0 0.0.0.0:22          0.0.0.0:*           LISTEN    8/sshd
tcp    0    0 :::80             :::*            LISTEN    14/httpd
tcp    0    0 :::22             :::*            LISTEN    8/sshd
root@b8d17d0f3941:~
root@b8d17d0f3941:~
15:03:12 # mysql -h 172.16.1.2 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 12
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| performance_schema |
+--------------------+
3 rows in set (0.00 sec)
mysql> use mysql
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select host,user,password from user;
+------------+--------+-------------------------------------------+
| host     | user   | password                  |
+------------+--------+-------------------------------------------+
| localhost  | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| 172.16.1.3 | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| 172.16.1.2 | root   | *BE78618CBAFFF409CE17D81579C1678B94439BE1 |
| %      | zabbix | *DEEF4D7D88CD046ECA02A80393B7780A63E7E789 |
+------------+--------+-------------------------------------------+
4 rows in set (0.00 sec)
mysql>
  可以看到数据库部署成功,并已经给予slave授予了权限。
  B、部署从库
  在test2节点部署
time ansible-playbook mysql_slave_install.yml --extra-vars "host=172.16.1.3 user=root mysql_master_ip=172.16.1.2 mysql_master_port=3306 mysql_master_user=root mysql_master_passwd=E4yR3WnoluSFTCBAI"  -k
  mysql_master_ip是mysql master的ip
  mysql_master_port是mysql master的mysql端口
  mysql_master_user是mysql master的mysql用户
  mysql_master_passwd是mysql 的密码
  如果你使用我模块部署mysql的master了,直接运行命令就行,如果没有,只想单独弄个从库,主库不弄,那么第一步创建mysql master就不需要,只需要你在mater里授予slave的权限,然后运行mysql slave的模块就行
  下面是运行情况
  
[root@puppet ansible]# time ansible-playbook mysql_slave_install.yml --extra-vars "host=172.16.1.3 user=root mysql_master_ip=172.16.1.2 mysql_master_port=3306 mysql_master_user=root mysql_master_passwd=E4yR3WnoluSFTCBAI"  -k
SSH password:
PLAY [172.16.1.3] *************************************************************
GATHERING FACTS ***************************************************************
ok: [172.16.1.3]
TASK: [common | Install initializtion require software] ***********************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Software To Redhat Client] ************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql User In Redhat Client] **************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Start Script To Redhat Client] ********
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Install Mysql Script  To Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Config To Redhat Client] **************
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Security Script To Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql Install Dir] ************************
ok: [172.16.1.3]
TASK: [mysql_slave_install | Uncompression Mysql Software To Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Modify Mysql Dir Permission In Redhat Client] ****
ok: [172.16.1.3] => (item=/data/mysql/datadir)
ok: [172.16.1.3] => (item=/data/mysql/basedir)
TASK: [mysql_slave_install | Install Mysql Script In Redhat Client] ***********
changed: [172.16.1.3]
TASK: [mysql_slave_install | Wait Untils Mysql Service Avaiable In Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Start Myql Security Script In Redhat Client] *****
changed: [172.16.1.3]
TASK: [mysql_slave_install | Add Boot Start Mysql Service In Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Copy Mysql Create Slave Script To Redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Create Mysql Master And Slave  In redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Delete Create Mysql Master And Slave Script  In redhat Client] ***
changed: [172.16.1.3]
TASK: [mysql_slave_install | Delete Mysql compression Software In Redhat Client] ***
changed: [172.16.1.3]
PLAY RECAP ********************************************************************
172.16.1.3         : ok=19   changed=16   unreachable=0  failed=0

real2m59.966s
user0m14.413s
sys0m0.987s
  部署完成,下面测试一下
15:26:22 # netstat -tlnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address         Foreign Address       State     PID/Program name
tcp    0    0 172.16.1.3:3306       0.0.0.0:*           LISTEN    -
tcp    0    0 0.0.0.0:22          0.0.0.0:*           LISTEN    8/sshd
tcp    0    0 :::80             :::*            LISTEN    14/httpd
tcp    0    0 :::22             :::*            LISTEN    8/sshd
root@4ac2891ba3fd:~
15:26:27 # mysql -h 172.16.1.3 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 16
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| performance_schema |
+--------------------+
3 rows in set (0.01 sec)
mysql> show processlist;
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
| Id | User    | Host       | db   | Command | Time | State                                     | Info       | Rows_sent | Rows_examined | Rows_read |
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
| 11 | system user |          | NULL | Connect |  192 | Waiting for master to send event                      | NULL       |     0 |       0 |     1 |
| 12 | system user |          | NULL | Connect |  192 | Slave has read all relay log; waiting for the slave I/O thread to update it | NULL       |     0 |       0 |     1 |
| 14 | root    | 172.16.1.3:53445 | NULL | Query   |  0 | NULL                                    | show processlist |     0 |       0 |     4 |
+----+-------------+------------------+------+---------+------+-----------------------------------------------------------------------------+------------------+-----------+---------------+-----------+
3 rows in set (0.00 sec)
mysql> show slave status\G
*************************** 1. row ***************************
         Slave_IO_State: Waiting for master to send event
          Master_Host: 172.16.1.2
          Master_User: mysql_sync
          Master_Port: 3306
        Connect_Retry: 60
        Master_Log_File: mysql-bin.000003
      Read_Master_Log_Pos: 1663
         Relay_Log_File: mysql-relay-bin.000002
        Relay_Log_Pos: 253
    Relay_Master_Log_File: mysql-bin.000003
       Slave_IO_Running: Yes
      Slave_SQL_Running: Yes
        Replicate_Do_DB:
      Replicate_Ignore_DB:
       Replicate_Do_Table:
     Replicate_Ignore_Table:
    Replicate_Wild_Do_Table:
  Replicate_Wild_Ignore_Table:
           Last_Errno: 0
           Last_Error:
         Skip_Counter: 0
      Exec_Master_Log_Pos: 1663
        Relay_Log_Space: 409
        Until_Condition: None
         Until_Log_File:
        Until_Log_Pos: 0
       Master_SSL_Allowed: No
       Master_SSL_CA_File:
       Master_SSL_CA_Path:
        Master_SSL_Cert:
      Master_SSL_Cipher:
         Master_SSL_Key:
    Seconds_Behind_Master: 0
Master_SSL_Verify_Server_Cert: No
        Last_IO_Errno: 0
        Last_IO_Error:
         Last_SQL_Errno: 0
         Last_SQL_Error:
  Replicate_Ignore_Server_Ids:
       Master_Server_Id: 2
1 row in set (0.00 sec)
  可以看到从库数据库创建成功,并且主从(sql与i这2个状态也是yes)创建成功。
  C、测试主从状态
  在master里创建一个数据库mysql_master,并创建表test插入数据
[root@puppet ansible]# ssh 172.16.1.2
root@172.16.1.2's password:
Last login: Thu Mar  5 15:02:39 2015 from 10.10.11.125
root@b8d17d0f3941:~
15:27:20 # mysql -h 172.16.1.2 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 17
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> create database mysql_master;
Query OK, 1 row affected (0.00 sec)
mysql> use mysql_master
Database changed
mysql> create table test(id int,name varchar(4));
Query OK, 0 rows affected (0.03 sec)
mysql> desc test;
+-------+------------+------+-----+---------+-------+
| Field | Type     | Null | Key | Default | Extra |
+-------+------------+------+-----+---------+-------+
| id  | int(11)  | YES  |   | NULL  |     |
| name  | varchar(4) | YES  |   | NULL  |     |
+-------+------------+------+-----+---------+-------+
2 rows in set (0.00 sec)
mysql> insert into test value(1,'test1');
Query OK, 1 row affected, 1 warning (0.00 sec)
mysql> insert into test value(2,'test2');
Query OK, 1 row affected, 1 warning (0.00 sec)
mysql> select * from test;
+------+------+
| id   | name |
+------+------+
|  1 | test |
|  2 | test |
+------+------+
2 rows in set (0.00 sec)
  然后去从库里查看
[root@puppet ansible]# ssh 172.16.1.3
root@172.16.1.3's password:
Last login: Thu Mar  5 15:25:06 2015 from 10.10.11.125
root@4ac2891ba3fd:~
15:31:05 # mysql -h 172.16.1.3 -u root -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 17
Server version: 5.5.21-log Source distribution
Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database       |
+--------------------+
| information_schema |
| mysql        |
| mysql_master     |
| performance_schema |
+--------------------+
4 rows in set (0.00 sec)
mysql> use mysql_master
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> show tables;
+------------------------+
| Tables_in_mysql_master |
+------------------------+
| test           |
+------------------------+
1 row in set (0.00 sec)
mysql> select * from test;
+------+------+
| id   | name |
+------+------+
|  1 | test |
|  2 | test |
+------+------+
2 rows in set (0.00 sec)
  可以看到从库也同步了数据,mysql主从创建成功。
  四、模块地址
  mysql master 地址
https://github.com/dl528888/ansible-examples/tree/master/mysql_master_install
  mysql slave地址
https://github.com/dl528888/ansible-examples/tree/master/mysql_slave_install
  


  
关注下面的标签,发现更多相似文章