php+zookeeper 集群管理

2018/03/24 | Linux,PHP,开源社区 | chenjie | 暂无评论 | 2941 views

上一篇提到了php操作zookeeper的一些常用curd操作和需要注意的问题本篇主要说下具体zookeeper的一种应用场景：集群管理（图片来自网络）在此我们主要关注两点监听机器的退出加入上图中所有机器约定在父节点GroupMembers下创建临时节点，然后监听父节点的子节点。一旦有机器挂掉，该机器与zookeeper的连接断开……

php+zookeeper的curd操作

2018/03/22 | PHP,开源社区 | chenjie | 2 条评论 | 4013 views

上一篇讲了一些安装流程，这篇来看下常用函数 http://php.net/manual/zh/book.zookeeper.php 我们用的比较多的应该是

public function connect( $host, $watcher_cb = null, $recv_timeout = 10000) {}

public function create( $path, $value, $acl, $flags = null ) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$aclArray = array(
  array(
    'perms'  => Zookeeper::PERM_ALL,
    'scheme' => 'world',
    'id'     => 'anyone',
  )
);
$path = '/path/to/newnode';
$realPath = $zookeeper->create($path, null, $aclArray);
if ($realPath)
  echo $realPath;
else
  echo 'ERR';
?>

public function delete( $path, $version = -1 ) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$path = '/path/to/node';
$r = $zookeeper->delete($path);
if ($r)
  echo 'SUCCESS';
else
  echo 'ERR';
?>

public function set( $path, $data, $version = -1, &$stat = null ) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$path = '/path/to/node';
$value = 'nodevalue';
$r = $zookeeper->set($path, $value);
if ($r)
  echo 'SUCCESS';
else
  echo 'ERR';
?>

public function get( $path, $watcher_cb = null, &$stat = null, $max_size = 0) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$path = '/path/to/node';
$value = 'nodevalue';
$zookeeper->set($path, $value);

$r = $zookeeper->get($path);
if ($r)
  echo $r;
else
  echo 'ERR';
?>

public function getChildren( $path, $watcher_cb = null ) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$path = '/zookeeper';
$r = $zookeeper->getchildren($path);
if ($r)
  var_dump($r);
else
  echo 'ERR';
?>

public function exists( $path, $watcher_cb = null ) {}
<?php
$zookeeper = new Zookeeper('locahost:2181');
$path = '/path/to/node';
$r = $zookeeper->exists($path);
if ($r)
  echo 'EXISTS';
else
  echo 'N/A or ERR';
?>

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

public function connect( $host, $watcher_cb = null, $recv_timeout = 10000) {}

public function create( $path, $value, $acl, $flags = null ) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$aclArray = array(

array(

'perms' => Zookeeper::PERM_ALL,

'scheme' => 'world',

'id' => 'anyone',

)

);

$path = '/path/to/newnode';

$realPath = $zookeeper->create($path, null, $aclArray);

if ($realPath)

echo $realPath;

else

echo 'ERR';

?>

public function delete( $path, $version = -1 ) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$path = '/path/to/node';

$r = $zookeeper->delete($path);

if ($r)

echo 'SUCCESS';

else

echo 'ERR';

?>

public function set( $path, $data, $version = -1, &$stat = null ) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$path = '/path/to/node';

$value = 'nodevalue';

$r = $zookeeper->set($path, $value);

if ($r)

echo 'SUCCESS';

else

echo 'ERR';

?>

public function get( $path, $watcher_cb = null, &$stat = null, $max_size = 0) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$path = '/path/to/node';

$value = 'nodevalue';

$zookeeper->set($path, $value);

$r = $zookeeper->get($path);

if ($r)

echo $r;

else

echo 'ERR';

?>

public function getChildren( $path, $watcher_cb = null ) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$path = '/zookeeper';

$r = $zookeeper->getchildren($path);

if ($r)

var_dump($r);

else

echo 'ERR';

?>

public function exists( $path, $watcher_cb = null ) {}

<?php

$zookeeper = new Zookeeper('locahost:2181');

$path = '/path/to/node';

$r = $zookeeper->exists($path);

if ($r)

echo 'EXISTS';

else

echo 'N/A or ERR';

?>

注意：以上代码均来自php官网，大家可以执行一遍就会发现不少warning报错，主要集中在节点不存在时候的创建、查询、……

php+zookeeper 安装介绍

2018/03/22 | PHP,开源社区,运维 | chenjie | 2 条评论 | 4389 views

环境介绍 Centos6.5 ，php5.6，zookeeper3.4.8(libzookeeper), zookeeper-0.2.2(php 扩展) 服务端安装这里我使用docker安装

docker run -p 2181:2181  --name my_zookeeper -d zookeeper:latest

1	docker run -p 2181:2181 --name my_zookeeper -d zookeeper:latest

注意要暴露2181端口给宿主机，宿主机2181端口也需要打开扩展安装安装li……

搭建es并设置访问控制

2017/11/27 | 运维 | chenjie | 暂无评论 | 2455 views

背景工作用到elasticsearch，为了方便学习需要自己搭建。那么怎么快速搭建呢，这里我用的是docker-compose（具体安装方式自行搜索不在此赘述）搭建es 为了方便我们建一个es的文件夹在es文件夹中创建docker-compose.yml文件如下

version: '2'
services:

  elasticsearch:
    image: elasticsearch:1.7.6
    container_name: med-news-es-dev
    ports:
      - "9200:9200"
    volumes:
     - $PWD/elasticsearch/config:/usr/share/elasticsearch/config
     - $PWD/elasticsearch/plugins:/usr/share/elasticsearch/plugins
    restart: always

1

2

3

4

5

6

7

8

9

10

11

12

version: '2'

services:

elasticsearch:

image: elasticsearch:1.7.6

container_name: med-news-es-dev

ports:

- "9200:9200"

volumes:

- $PWD/elasticsearch/config:/usr/share/elasticsearch/config

- $PWD/elasticsearch/plugins:/usr/share/elasticsearch/plugins

restart: always

特别提……

MySQL批量删除多库指定多前缀表的方法【升级版】

2017/11/23 | Linux,MySQL | chenjie | 3 条评论 | 5078 views

背景之前写过一遍 MySQL批量删除指定多前缀表的方法可以简单对单库多表进行批量删除，但是需要每次修改具体的时间，对于多库处理也不是很友好，所以这次一并优化下。修改首先我修改了具体批量删除的脚本 abcd_drop.sh

#!/bin/bash
table_arr=("a" "b" "c" "d") #所要删除的表前缀数组（不含日期）
database="abcd" #所要删除的表所在的库
user="root" #数据库账号
password="password" #数据库密码
rule="_"$(date -d  "-2 month" +%Y%m)#所要删除的表前缀的日期特征规则（修改）
host="xxx.xxx.xxx.xxx" #主机ip地址（新增）
for table_pre in ${table_arr[@]}
do
        drop_table=$(mysql -h${host}  -u${user} -p${password} -e "SELECT CONCAT( 'DROP TABLE ', GROUP_CONCAT(table_name) , ';' ) AS statement FROM information_schema.tables WHERE table_schema = '${database}' AND table_name LIKE '${table_pre}${rule}%';"| grep -v statement)
        echo ${drop_table}
        mysql -h${host}  -u${user} -p${password} -e "use ${database};${drop_table}"  
done

1

2

3

4

5

6

7

8

9

10

11

12

13

#!/bin/bash

table_arr=("a" "b" "c" "d") #所要删除的表前缀数组（不含日期）

database="abcd" #所要删除的表所在的库

user="root" #数据库账号

password="password" #数据库密码

rule="_"$(date -d "-2 month" +%Y%m)#所要删除的表前缀的日期特征规则（修改）

host="xxx.xxx.xxx.xxx" #主机ip地址（新增）

for table_pre in ${table_arr[@]}

do

drop_table=$(mysql -h${host} -u${user} -p${password} -e "SELECT CONCAT( 'DROP TABLE ', GROUP_CONCAT(table_name) , ';' ) AS statement FROM information_schema.tables WHERE table_schema = '${database}' AND table_name LIKE '${table_pre}${rule}%';"| grep -v statement)

echo ${drop_table}

mysql -h${host} -u${user} -p${password} -e "use ${database};${drop_table}"

done

注:代码修改了rule的获取从手动填写改成自……