Postgresql 异步流复制 详解及配置切换

#######
1,postgresql移步同步 and 主备切换
2,postgresql 同步 and 主备切换
3,archive 数据同步
参考: <<从小工到专家>>

postgres hot_standby 主从配置部署: (hot_standy)
版本: postgresql 9.6.2
Centos 6.8 x86 64bit
目录: /usr/local/pgsql* --安装目录
/data/postgres/posdb --数据目录
配置文件: pg_hba.conf 网管控制(配置参数)
postgres.conf 数据库参数配置文件
recovery.conf 备库需手动创建的 配置同步参数文件
主库: 10.0.1.82 端口: 5438
备库: 192.168.41.212 端口: 5438

流复制: (原理详解)
9.0开始提供的一种新的传递WAL 日志的方式,只要primary 数据库 一产生日志,就会传递到standby 数据库. (1,异步,2,同步) 两种方式. (9.2 增加了级联复制功能 ), 9.0之前,主从需第三方同步拷贝
数据同步方式时 : 在primary 提交事务时,一定会等到WAL 日志传递到standby 后才返回,这样可以得到standby 数据完全和 primary 数据库同步. 没有一点落后.(自动切换,可以达到零丢失)
数据异步同步方式 : Primary 提交事务后,不必等日志传递到standby 就即可返回. 所以standby 数据库通常 比primary 落后很少.

standby 运行原理:
postgresql 数据库异常中止后,数据库重启,会重放停机前最后一个checkpoint 点之后的 WAL 日志. 再把数据库恢复到停机时的状态.
创建standby 的过程分为俩大步骤:
a,生成一个基础备份,通过pg_start_backup('db_name'),pg_stop_backup();
select pg_start_backup('target')
--Ps: 可以使用pg_basebackup 来 完成基础备份的步骤.
b,拷贝备份过程中的所有WAL 日志文件.

pg_basebackup 命令简介:
这个工具会把整个数据库实例都拷贝出来,而 不只是 把实例中的部分(某个数据库或某张表) 单独备份出来. 该工具需要配置 pg_hba.conf 参数文件

参数:
-D directory 或 --pgdata=directory 指定把备份写到那个目录.(如果目录不存在,会自动创建)
-F format 或 --format=format : 指定输出的格式 目前支持两种格式:
-x 或 --xlog : 备份时会把备份中产生的xlog 文件也自动备份出来. 这样在数据库恢复时,应用这些xlog 文件,把数据库推到一个一致点. 设置这个选项需要设置 wal_keep_segments 参数(以抱枕在备份过程中,需要的WAL日志文件不会被覆盖 ). 与选项 -X fetch 完全一样.
-X method 或 xlog-method=method: 可以取的值为"f","fetch","s","stream" ,当为f时,与fetch意义相同,与-x 参数一样. 当为"s",stream 表示意思也相同,表示备份开始后,启动另一个流复制从主库接收WAL日志 .(这种方式避免了,使用-X f时,主库上的WAL日志有可能被覆盖从而导致失败的问题.),使用这种连接,主库需要配置 max_wal_senders 至少需要大于2
-z 或 --gzip,仅能与tar 输出模式配合使用. 表示tar 备份是经过gzip 压缩的. 生成tar.gz 备份包.
-Z level 或 --compress=level,指定gzip 压缩级别(1-9),级别越高,耗CPU 越厉害.
-c fast | spread 或 --checkpoint=fast | spread : 设置checkpoint 的模式是fast还是spread .
-l label 或 --label=label,指定备份的一个标示. 备份的标识是一个任意字符串,便于今后维护识别.
-P 或 --progress,允许在备份过程中实时打印备份进度.
-v 或--verbose,详细模式,在使用-P 参数后,会打印出正在备份的具体的信息.
-V 或 --version,打印pg_basebackup 的版本后,退出.
----------------------------
-h host 或 --host =host,执行连接数据库的IP地址或主机名
-p port 或 --port=port 指定连接端口
-s interval 或 --status-interval = interval: 指定向服务器周期反馈状态的秒数,如果服务器配置了 流复制的超时,在使用--xlog=stream 选项时,这需要设置这个参数. 默认为10s,如果设置为0,表示不向服务器反馈状态.

eg: pg_basebackup -F p --progress -D /data/postgresql/postdb -h 10.0.1.82 -p 5438 -U replica --password (基础备份)
############# 我是华丽分界线 ################

安装postgresql :
groupadd -g 1200 postgres
useradd -m -u 1100 -g postgres postgres
mkdir -pv /data/PostgreSQL/{postgresdb,postgreslog}

gunzip postgresql-9.6.2-3-linux-x64-binaries.tar.gz
tar -xvf postgresql-9.6.2-3-linux-x64-binaries.tar -C /usr/local/

初始化postgressql 数据库:
cd /usr/local/pgsql-9.6.2/bin
./initdb -E utf8 -D /data/PostgreSQL/postgresdb

主库: postgres.conf 配置 (4GB-Memory)
## authentic setting ##
port = 5438
max_connections = 500
unix_socket_directories = '/tmp'
listen_addresses = '*'
superuser_reserved_connections = 5
#uthentication_timeout = 60
deadlock_timeout =2000
max_locks_per_transaction = 64

## base setting ##
datestyle = 'iso,mdy'
timezone = 'PRC'
lc_messages = 'en_US.UTF-8'
lc_monetary = 'en_US.UTF-8'
lc_numeric = 'en_US.UTF-8'
lc_time = 'en_US.UTF-8'
default_text_search_config = 'pg_catalog.english'

## log setting ##
logging_collector = on
log_destination = 'csvlog'
log_directory = '/data/postgres/poslog'
# -- every day on logs -- #
log_filename = 'pglog5438-%Y-%m-%d_%H%M%S.log'
log_file_mode = 0600
log_connections = on
log_disconnections = off
log_checkpoints = on
log_rotation_age = 1d
log_rotation_size = 200MB
log_truncate_on_rotation = off
log_timezone = 'PRC'
log_lock_waits = on

log_min_duration_statement = 3s
log_lock_waits = on
log_min_messages = info
log_min_error_statement = info

## memory setting ##
shared_buffers = 512MB
temp_buffers = 16MB
work_mem = 32MB
effective_cache_size = 2GB
maintenance_work_mem = 128MB
#max_stack_depth = 2MB
dynamic_shared_memory_type = posix

## WAL setting ##
fsync = on
synchronous_commit = on
wal_sync_method = fdatasync
# -- yixia is defaults -- #
full_page_writes = on
wal_buffers = 16MB
wal_writer_delay = 200ms
commit_delay = 0
commit_siblings = 5
#wal_level = archive
#wal_level = hot_standby
archive_mode = on
archive_command = 'cp %p /data/postgres/pos_archive/%f'

## statistic setting ##
track_activities = on
log_statement_stats = on
# log_parser_stats =
# log_planner_stats =
# log_executor_stats =
autovacuum = on
track_counts = on

## async standby setting ##
max_wal_senders = 5
wal_level = hot_standby
#listen_addresses = '*'
wal_keep_segments = 10240
wal_sender_timeout = 120s

## 初次需要修改参数 ##
listener_addresses = '*' --可以是IP,也可以是 ' * ' 替代.
wal_level = hot_standby --热备模式开启
max_wal_sender = 5 --可以并行设置几个流复制连接进程.( 几个从,设置几个)
wal_keep_segments = 10240 #重要配置 流复制
wal_send_timeout = 60s --可防止逻辑错误,延缓同步时间.
max_connections = 512 --standby此参数设置最好比primary 设置的要大.
archive_mode = on --允许归档
archive_command = 'cp % /data/postgreslog/archivelog/%f' --归档路径
关于wal 日志归档描述:
--以上是主库设置.

编辑环境变量:
[postgres@martin.lee-test ~]$ cat .bash_profile
# .bash_profile

# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin
export PATH
export DATADIR=/data/postgres/posdb
export BASEDIR=/usr/local/pgsql-9.6.2
export PATH=$BASEDIR/bin:$PATH:$HOME/bin:$PATH

编辑 pg_hba.conf 配置参数文件:
# TYPE DATABASE USER ADDRESS METHOD

# "local" is for Unix domain socket connections only
local all all trust
# IPv4 local connections:
host all all 127.0.0.1/32 trust
# IPv6 local connections:
host all all ::1/128 trust
host all all 0.0.0.0/0 trust #因本地测试环境,我全放开
# Allow replication connections from localhost,by a user with the
# replication privilege.
#local replication postgres trust
#host replication postgres 127.0.0.1/32 trust
host replication postgres ::1/128 trust
host replication replica 192.168.41.0/24 trust #流复制IP target 端 (网段)
host replication replica 10.0.1.0/24 trust #流复制IP target 端 (网段)
--replication 表示支持流复制. 使用的是replica 用户


启动主库,postgresql 数据库
a,通过
/usr/local/pgsql-9.6.2/bin/postgres -D /data/postgres/posdb
b,pg_ctl start -D /data/postgres/posdb
检测 启动进程
[root@martin.lee-test posdb]# lsof -i:5438
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
postgres 11734 postgres 3u IPv4 19736071 0t0 TCP *:5438 (LISTEN)
postgres 11734 postgres 4u IPv6 19736072 0t0 TCP *:5438 (LISTEN)
postgres 11960 postgres 10u IPv4 19738713 0t0 TCP limin-test.novalocal:5438->192.168.41.212:56398 (ESTABLISHED)


# 备库设置:
a,如果为开始的初始话数据库,不需要删除 /data/目录下的文件. 如果不是,最好删除.
b,备份复制: pg_basebackup -F p --progress -D /data/postgresql/postdb -h 10.0.1.82 -p 5438 -U replica --password
c,手动创建recovery.conf 配置文件:
[postgres@newmachine postdb]$ cat recovery.conf
standby_mode = on
trigger_file = '/data/postgresql/postlog/trigger.kenyou'
recovery_target_timeline = 'latest'
restore_command = 'cp %p /data/postgresql/postdb/%f'
primary_conninfo = 'host=10.0.1.82 port=5438 user=replica password=replica'
d,根据主库的postgresql.conf 配置文件 修改参数配置:
1,listen_addresses = '* '
2,wal_level = hot_standby
3,max_connections = xxx,# 一般比主库大一些.
4,hot_standby = on
5,max_standby_streaming_delay = 30s
6. wal_receiver_status_interval = 10s
7,hot_standby_feedback = on # 如果有错误的数据复制,是否向 主进行范例.

### 备库 postgresql.conf 配置文件 ####
[postgres@newmachine postdb]$ cat recovery.conf
standby_mode = on
trigger_file = '/data/postgresql/postlog/trigger.kenyou'
recovery_target_timeline = 'latest'
restore_command = 'cp %p /data/postgresql/postdb/%f'
primary_conninfo = 'host=10.0.1.82 port=5438 user=replica password=replica'

[postgres@newmachine postdb]$ cat postgresql.conf
## authentic setting ##
port = 5438
max_connections = 550
unix_socket_directories = '/tmp'
listen_addresses = '*'
superuser_reserved_connections = 5
#uthentication_timeout = 60
deadlock_timeout =2000
max_locks_per_transaction = 64


## base setting ##
datestyle = 'iso,mdy'
timezone = 'PRC'
lc_messages = 'en_US.UTF-8'
lc_monetary = 'en_US.UTF-8'
lc_numeric = 'en_US.UTF-8'
lc_time = 'en_US.UTF-8'
default_text_search_config = 'pg_catalog.english'

## log setting ##
logging_collector = on
log_destination = 'csvlog'
log_directory = '/data/postgresql/postlog'
# -- every day on logs -- #
log_filename = 'pglog5438-%Y-%m-%d_%H%M%S.log'
log_file_mode = 0600
log_connections = on
log_disconnections = off
log_checkpoints = on
log_rotation_age = 1d
log_rotation_size = 200MB
log_truncate_on_rotation = off
log_timezone = 'PRC'
log_lock_waits = on

log_min_duration_statement = 3s
log_lock_waits = on
log_min_messages = info
log_min_error_statement = info

## memory setting ##
shared_buffers = 512MB
temp_buffers = 16MB
work_mem = 32MB
effective_cache_size = 2GB
maintenance_work_mem = 128MB
#max_stack_depth = 2MB
dynamic_shared_memory_type = posix

## WAL setting ##
fsync = on
synchronous_commit = on
wal_sync_method = fdatasync
# -- yixia is defaults -- #
full_page_writes = on
wal_buffers = 16MB
wal_writer_delay = 200ms
commit_delay = 0
commit_siblings = 5
#wal_level = archive
#wal_level = hot_standby
archive_mode = on
archive_command = 'cp %p /data/postgresql/postdb/%f'
#restore_command = 'cp %p /data/postgresql/postdb/%f'

## statistic setting ##
track_activities = on
log_statement_stats = on
autovacuum = on
track_counts = on

## async standby setting ##
max_wal_senders = 5
wal_level = hot_standby
#listen_addresses = '*'
wal_keep_segments = 10240
wal_sender_timeout = 120s
hot_standby = on
hot_standby_feedback = on
max_standby_streaming_delay = 20s
wal_receiver_status_interval = 1s

## 启动备库:
pg_ctl start -D /data.....

##检测主从 复制状态: (主库上查看)
select client_addr,sync_state from pg_stat_replication;
postgres=# select client_addr,sync_state from pg_stat_replication;
client_addr | sync_state
----------------+------------
192.168.41.212 | async
(1 row)

postgres=#
postgres=# select * from pg_stat_replication;
pid | usesysid | usename | application_name | client_addr | client_hostname | client_port | ba
ckend_start | backend_xmin | state | sent_location | write_location | flush_location | replay_lo
cation | sync_priority | sync_state
-------+----------+---------+------------------+----------------+-----------------+-------------+-----------
--------------------+--------------+-----------+---------------+----------------+----------------+----------
-------+---------------+------------
11960 | 16568 | replica | walreceiver | 192.168.41.212 | | 56398 | 2017-08-16
17:37:45.876011+08 | 1761 | streaming | 0/801DB70 | 0/801DB70 | 0/801DB70 | 0/801DB70
| 0 | async
(1 row)

## 数据 ddl,dml 操作测试:

##standby 只读,所以任何操作,都会告警失败:
postgres=# drop database martinli;
ERROR: cannot execute DROP DATABASE in a read-only transaction

[postgres@limin-test ~]$ netstat -lntup|grep 5438 && ps -ef|grep postmaster
(Not all processes could be identified,non-owned process info
will not be shown,you would have to be root to see it all.)
tcp 0 0 0.0.0.0:5438 0.0.0.0:* LISTEN 11734/postgres
tcp 0 0 :::5438 :::* LISTEN 11734/postgres

主库 sender :
[postgres@limin-test ~]$ ps -ef |grep postgres |grep sender
postgres 11960 11734 0 Aug16 ? 00:00:19 postgres: wal sender process replica 192.168.41.212(56398) streaming 0/801F168
postgres 24621 20934 0 16:56 pts/0 00:00:00 grep sender

备库 recover :
[postgres@newmachine postdb]$ ps -ef |grep postgres |grep recover
postgres 27798 27796 0 Aug16 ? 00:00:00 postgres: startup process recovering 000000010000000000000008
postgres 28948 28759 0 08:53 pts/4 00:00:00 grep recover
----------------- 异步 同步部署完成 ------------

异步postgresql 主备切换:
1,停止主库:
[postgres@limin-test ~]$ pg_ctl stop -D /data/postgres/posdb/
waiting for server to shut down....... done
server stopped
------
主库 log 日志:
2017-08-17 17:00:46.522 CST,11734,59940c60.2dd6,5,2017-08-16 17:12:00 CST,LOG,00000,"database system is shut down",""
--------
此时备库的日志:
",""
2017-08-17 08:58:19.789 CST,28962,5994ea2b.7122,1,2017-08-17 08:58:19 CST,FATAL,XX000," could not connect to the primary server: could not connect to server: Connection refused
Is the server running on host ""10.0.1.82"" and accepting
TCP/IP connections on port 5438?
",""
----------
2,查看备库的 recovery.conf 参数文件, 在对应的目录下创建 trigger 文件.
[postgres@newmachine postdb]$ cat recovery.conf
standby_mode = on
trigger_file = '/data/postgresql/postlog/trigger.kenyou'
recovery_target_timeline = 'latest'
restore_command = 'cp %p /data/postgresql/postdb/%f'
primary_conninfo = 'host=10.0.1.82 port=5438 user=replica password=replica'

cd /data/postgresql/postlog/
touch trigger.kenyou # 这一步很重要. 创建后,ll 查看,并没有什么,但是,日志及recovery.conf 文件变了:
--------------- 数据状态查看------
通过pg_controldata :
未创建 ( touch trigger.kenyou ) 触发文件之前的 状态信息:
备库:
[postgres@newmachine postlog]$ pg_controldata -D /data/postgresql/postdb/
pg_control version number: 960
Catalog version number: 201608131
Database system identifier: 6410192200887248642
Database cluster state: in archive recovery # 提示恢复状态.
pg_control last modified: Thu 17 Aug 2017 08:59:15 AM CST
Latest checkpoint location: 0/9000028
Prior checkpoint location: 0/801F1A0
Latest checkpoint's REDO location: 0/9000028
Latest checkpoint's REDO WAL file: 000000010000000000000009
Latest checkpoint's TimeLineID: 1
Latest checkpoint's PrevTimeLineID: 1
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:1761
Latest checkpoint's NextOID: 16571
Latest checkpoint's NextMultiXactId: 1
Latest checkpoint's NextMultiOffset: 0
Latest checkpoint's oldestXID: 1668
Latest checkpoint's oldestXID's DB: 1
Latest checkpoint's oldestActiveXID: 0
Latest checkpoint's oldestMultiXid: 1
Latest checkpoint's oldestMulti's DB: 1
Latest checkpoint's oldestCommitTsXid:0
Latest checkpoint's newestCommitTsXid:0
Time of latest checkpoint: Thu 17 Aug 2017 05:00:44 PM CST
Fake LSN counter for unlogged rels: 0/1
Minimum recovery ending location: 0/9000098
Min recovery ending loc's timeline: 1
Backup start location: 0/0
Backup end location: 0/0
End-of-backup record required: no
wal_level setting: replica
wal_log_hints setting: off
max_connections setting: 500
max_worker_processes setting: 8
max_prepared_xacts setting: 0
max_locks_per_xact setting: 64
track_commit_timestamp setting: off
Maximum data alignment: 8
Database block size: 8192
Blocks per segment of large relation: 131072
WAL block size: 8192
Bytes per WAL segment: 16777216

创建 ( ) 触发文件之后的 状态信息:
Database cluster state: in production # 变法了.
pg_control last modified: Thu 17 Aug 2017 09:10:30 AM CST
Latest checkpoint location: 0/9000138
Prior checkpoint location: 0/9000028
Latest checkpoint's REDO location: 0/9000100
Latest checkpoint's REDO WAL file: 000000020000000000000009
Latest checkpoint's TimeLineID: 2
Latest checkpoint's PrevTimeLineID: 2
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:1761
Latest checkpoint's NextOID: 16571
Latest checkpoint's NextMultiXactId: 1
Latest checkpoint's NextMultiOffset: 0
Latest checkpoint's oldestXID: 1668
Latest checkpoint's oldestXID's DB: 1
Latest checkpoint's oldestActiveXID: 1761
Latest checkpoint's oldestMultiXid: 1
Latest checkpoint's oldestMulti's DB: 1
Latest checkpoint's oldestCommitTsXid:0
Latest checkpoint's newestCommitTsXid:0
Time of latest checkpoint: Thu 17 Aug 2017 09:10:30 AM CST
Fake LSN counter for unlogged rels: 0/1
Minimum recovery ending location: 0/0
Min recovery ending loc's timeline: 0
Backup start location: 0/0
Backup end location: 0/0
End-of-backup record required: no
wal_level setting: replica
wal_log_hints setting: off
max_connections setting: 550
max_worker_processes setting: 8
max_prepared_xacts setting: 0
max_locks_per_xact setting: 64
track_commit_timestamp setting: off
Maximum data alignment: 8
Database block size: 8192
Blocks per segment of large relation: 131072
WAL block size: 8192
Bytes per WAL segment: 16777216
Maximum length of identifiers: 64
Maximum columns in an index: 32
Maximum size of a TOAST chunk: 1996
Size of a large-object chunk: 2048
Date/time type storage: 64-bit integers
Float4 argument passing: by value
Float8 argument passing: by value
Data page checksum version: 0

同时,恢复配置文件由 recovery.conf 变为了 recovery.done
[postgres@newmachine postdb]$ cat recovery.done
standby_mode = on
trigger_file = '/data/postgresql/postlog/trigger.kenyou'
recovery_target_timeline = 'latest'
restore_command = 'cp %p /data/postgresql/postdb/%f'
primary_conninfo = 'host=10.0.1.82 port=5438 user=replica password=replica'
------log 日志状态 ------
",""
2017-08-17 09:10:25.520 CST,29138,5994ed01.71d2,2017-08-17 09:10:25 CST,"could not connect to the primary server: could not connect to server: Connection refused
Is the server running on host ""10.0.1.82"" and accepting
TCP/IP connections on port 5438?
2017-08-17 09:10:30.522 CST,27798,5993a108.6c96,6,2017-08-16 09:34:00 CST,1/0,"trigger file found: /data/postgresql/postlog/trigger.kenyou",42)">## 这里找到了一个trigger 文件,(touch trigger.kenyou 后)
2017-08-17 09:10:30.522 CST,7,2017-08-16 09:34:00 CST,"redo done at 0/9000028",""
2017-08-17 09:10:30.522 CST,8,"last completed transaction was at log time 2017-08-16 17:57:07.604087+08",""
2017-08-17 09:10:30.587 CST,9,"selected new timeline ID: 2",""
2017-08-17 09:10:30.788 CST,10,"archive recovery complete",""
2017-08-17 09:10:30.844 CST,11,"MultiXact member wraparound protections are now enabled",""
2017-08-17 09:10:30.868 CST,27800,5993a109.6c98,844,2017-08-16 09:34:01 "
2017-08-17 09:10:30.870 CST,27796,5993a108.6c94,3,"database system is ready to accept connections",""
2017-08-17 09:10:30.870 CST,29142,5994ed06.71d6,2017-08-17 09:10:30 CST,"autovacuum launcher started",""
2017-08-17 09:10:30.940 CST,845,2017-08-16 09:34:01 CST,"checkpoint complete: wrote 0 buffers (0.0%); 0 transaction log file(s) added,0 removed,0 recycled; write=0.001 s,sync=0.000 s,total=0.072 s; sync files=0,longest=0.000 s,average=0.000 s; distance=0 kB,estimate=14633 kB",""
2017-08-17 09:15:30.946 CST,846,"checkpoint starting: time",""
2017-08-17 09:15:31.091 CST,847,"checkpoint complete: wrote 1 buffers (0.0%); 0 transaction log file(s) added,0 recycled; write=0.102 s,sync=0.018 s,total=0.144 s; sync files=1,longest=0.018 s,average=0.018 s; distance=0 kB,estimate=13170 kB",""
--------------

主库:
[postgres@martin.lee-test posdb]$ pg_controldata -D /data/postgres/posdb/
pg_control version number: 960
Catalog version number: 201608131
Database system identifier: 6410192200887248642
Database cluster state: shut down ## 因关闭了,所以主库的状态不会改变.
pg_control last modified: Thu 17 Aug 2017 05:00:46 PM CST
Latest checkpoint location: 0/9000028
Prior checkpoint location: 0/801F1A0
Latest checkpoint's REDO location: 0/9000028
Latest checkpoint's REDO WAL file: 000000010000000000000009
Latest checkpoint's TimeLineID: 1
Latest checkpoint's PrevTimeLineID: 1
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:1761
Latest checkpoint's NextOID: 16571
Latest checkpoint's NextMultiXactId: 1
Latest checkpoint's NextMultiOffset: 0
Latest checkpoint's oldestXID: 1668
Latest checkpoint's oldestXID's DB: 1
Latest checkpoint's oldestActiveXID: 0
Latest checkpoint's oldestMultiXid: 1
Latest checkpoint's oldestMulti's DB: 1
Latest checkpoint's oldestCommitTsXid:0
Latest checkpoint's newestCommitTsXid:0
Time of latest checkpoint: Thu 17 Aug 2017 05:00:44 PM CST
Fake LSN counter for unlogged rels: 0/1
Minimum recovery ending location: 0/0
Min recovery ending loc's timeline: 0
Backup start location: 0/0
Backup end location: 0/0
End-of-backup record required: no
wal_level setting: replica
wal_log_hints setting: off
max_connections setting: 500
max_worker_processes setting: 8
max_prepared_xacts setting: 0
max_locks_per_xact setting: 64
track_commit_timestamp setting: off
Maximum data alignment: 8
Database block size: 8192
Blocks per segment of large relation: 131072
WAL block size: 8192
Bytes per WAL segment: 16777216
Maximum length of identifiers: 64
Maximum columns in an index: 32
Maximum size of a TOAST chunk: 1996
Size of a large-object chunk: 2048
Date/time type storage: 64-bit integers
Float4 argument passing: by value
Float8 argument passing: by value
Data page checksum version: 0

新主库监听检测:
[postgres@newmachine postlog]$ ps -ef |grep pos |grep sender
postgres 29186 27796 0 09:27 ? 00:00:00 postgres: wal sender process replica 10.0.1.82(16143) streaming 0/9000480
postgres 29200 28408 0 09:30 pts/3 00:00:00 grep sender


3,把 原备库的 recover.conf 文件 拷贝至原主库,修改对应信息:
[postgres@limin-test posdb]$ cat recovery.conf
standby_mode = on
trigger_file = '/data/postgres/posdb/trigger.kenyou' ## 这里创建需要注意,与原主对应.
recovery_target_timeline = 'latest'
restore_command = 'cp %p /data/postgres/poslog/%f'
#primary_conninfo = 'host=10.0.1.82 port=5438 user=replica password=replica'
primary_conninfo = 'host=192.168.41.212 port=5438 user=replica password=replica'

4,启动原主库 (现在的备库)
pg_ctl start -D /data/postgres/posdb/
---------------
[postgres@martin.lee-test posdb]$ ps -ef |grep pos |grep recover
postgres 24823 24821 0 17:31 ? 00:00:00 postgres: startup process recovering 000000020000000000000009
postgres 24834 21610 0 17:31 pts/2 00:00:00 grep recover

--状态检测(新备库)
[postgres@limin-test posdb]$ pg_controldata -D /data/postgres/posdb/
pg_control version number: 960
Catalog version number: 201608131
Database system identifier: 6410192200887248642
Database cluster state: in archive recovery
pg_control last modified: Thu 17 Aug 2017 05:29:05 PM CST
Latest checkpoint location: 0/9000028
Prior checkpoint location: 0/9000028
Latest checkpoint's REDO location: 0/9000028
Latest checkpoint's REDO WAL file: 000000010000000000000009
Latest checkpoint's TimeLineID: 1
Latest checkpoint's PrevTimeLineID: 1
Latest checkpoint's full_page_writes: on
Latest checkpoint's NextXID: 0:1761
Latest checkpoint's NextOID: 16571

验证: 在新主库(原主库上)
martinli=# select * from pg_stat_replication
martinli-# ;
pid | usesysid | usename | application_name | client_addr | client_hostname | client_port | backend_start | b
ackend_xmin | state | sent_location | write_location | flush_location | replay_location | sync_priority | sync_state
-------+----------+---------+------------------+-------------+-----------------+-------------+-------------------------------+--
------------+-----------+---------------+----------------+----------------+-----------------+---------------+------------
29278 | 16568 | replica | walreceiver | 10.0.1.82 | | 17444 | 2017-08-17 09:51:12.822522+08 |
1762 | streaming | 0/90164E0 | 0/90164E0 | 0/90164E0 | 0/90164E0 | 0 | async
(1 row)

martinli=# select client_addr,sync_state from pg_stat_replication ;
client_addr | sync_state
-------------+------------
10.0.1.82 | async
(1 row)
# 数据 dml,ddl 操作测试: .此处省略 N 颗 字........
# 新备库 做 ddl,dml 操作,查看 是否报错
martinli=# \dt test
List of relations
Schema | Name | Type | Owner
--------+------+-------+----------
public | test | table | postgres
(1 row)

martinli=# drop table test;
ERROR: cannot execute DROP TABLE in a read-only transaction
-------------- 我是华丽分割线 --------------END ----------
################## 参考 ############
原从库操作(原主库宕机情况下将其作为主库操作):
在之前备机上的recovery.conf中配置trigger_file = ‘/data/pgdata/pg_stand_by/trigger.unl’
touch /data/pgdata/pg_stand_by/trigger.unl
修改 pg_hba.conf:
增加
host replication replica 172.18.18.99/32 md5
host replication replica 172.18.18.100/32 md5
重启从库: /usr/pgsql9.3.4/bin/pg_ctl restart -D /data/pgdata/pg_stand_by
查看是否切换成功:/usr/pgsql9.3.4/bin/pg_controldata /data/pgdata/pg_stand_by -》Database cluster state: in production 表示是主库
recovery.conf文件名字变成了recovery.done
3》原主库操作(恢复原主库为从库):
cp /usr/pgsql9.3.4/share/recovery.conf.sample /data/pgdata/pg_primary/recovery.conf
修改recovery.conf:
recovery_target_timeline = ‘latest’
standby_mode = on
primary_conninfo = ‘host=172.18.18.101 port=3121 user=replica password=replica’
修改postgresql.conf文件:
hot_standby = on
启动原主库(当前从库):/usr/pgsql9.3.4/bin/pg_ctl start -D /data/pgdata/pg_primary
4》修改100机器从库对应的主库信息:
修改recovery.conf :
重启从库:/usr/pgsql9.3.4/bin/pg_ctl restart -D /data/pgdata/pg_stand_by -m fast
5》检查主从是否切换成功:
在新的主库上执行:
postgres=# select * from pg_stat_replication;
##################

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


文章浏览阅读601次。Oracle的数据导入导出是一项基本的技能,但是对于懂数据库却不熟悉Oracle的同学可能会有一定的障碍。正好在最近的一个项目中碰到了这样一个任务,于是研究了一下Oracle的数据导入导出,在这里跟大家分享一下。......_oracle 迁移方法 对比
文章浏览阅读553次。开头还是介绍一下群,如果感兴趣polardb ,mongodb ,mysql ,postgresql ,redis 等有问题,有需求都可以加群群内有各大数据库行业大咖,CTO,可以解决你的问题。加群请联系 liuaustin3 ,在新加的朋友会分到2群(共700多人左右 1 + 2)。最近我们在使用MYSQL 8 的情况下(8.025)在数据库运行中出现一个问题 参数prefer_order_i..._mysql prefer_ordering_index
文章浏览阅读3.5k次,点赞3次,收藏7次。折腾了两个小时多才成功连上,在这分享一下我的经验,也仅仅是经验分享,有不足的地方欢迎大家在评论区补充交流。_navicat连接opengauss
文章浏览阅读2.7k次。JSON 代表 JavaScript Object Notation。它是一种开放标准格式,将数据组织成中详述的键/值对和数组。_postgresql json
文章浏览阅读2.9k次,点赞2次,收藏6次。navicat 连接postgresql 注:navicat老版本可能报错。1.在springboot中引入我们需要的依赖以及相应版本。用代码生成器生成代码后,即可进行增删改查(略)安装好postgresql 略。更改配置信息(注释中有)_mybatisplus postgresql
文章浏览阅读1.4k次。postgre进阶sql,包含分组排序、JSON解析、修改、删除、更新、强制踢出数据库所有使用用户、连表更新与删除、获取今年第一天、获取近12个月的年月、锁表处理、系统表使用(查询所有表和字段及注释、查询表占用空间)、指定数据库查找模式search_path、postgre备份及还原_pgsql分组取每组第一条
文章浏览阅读3.3k次。上一篇我们学习了日志清理,日志清理虽然解决了日志膨胀的问题,但就无法再恢复检查点之前的一致性状态。因此,我们还需要日志归档,pg的日志归档原理和Oracle类似,不过归档命令需要自己配置。以下代码在postmaster.c除了开启归档外,还需要保证wal_level不能是MINIMAL状态(因为该状态下有些操作不会记录日志)。在db启动时,会同时检查archive_mode和wal_level。以下代码也在postmaster.c(PostmasterMain函数)。......_postgresql archive_mode
文章浏览阅读3k次。系统:ubuntu22.04.3目的:利用向日葵实现windows远程控制ubuntu。_csdn局域网桌面控制ubuntu
文章浏览阅读1.6k次。表分区是解决一些因单表过大引用的性能问题的方式,比如某张表过大就会造成查询变慢,可能分区是一种解决方案。一般建议当单表大小超过内存就可以考虑表分区了。1,继承式分区,分为触发器(trigger)和规则(rule)两种方式触发器的方式1)创建表CREATE TABLE "public"."track_info_trigger_partition" ( "id" serial, "object_type" int2 NOT NULL DEFAULT 0, "object_name..._pg数据表分区的实现
文章浏览阅读3.3k次。物联网平台开源的有几个,就我晓得的有、、thingskit、JetLink、DG-iot(还有其他开源的,欢迎在评论区留言哦!),然后重点分析了下ThingsBoard、ThingsPanel和JetLink,ThingsBoard和Jetlinks是工程师思维产品,可以更多的通过配置去实现开发的目的,ThingsPanel是业务人员思路产品,或者开发或者用,避免了复杂的配置带来的较高学习门槛。ThingsBoard和Jetlinks是Java技术体系的,ThingsPanel是PHP开发的。_jetlinks和thingsboard
文章浏览阅读3.8k次。PostgreSQL 数据类型转换_pgsql数字转字符串
文章浏览阅读7k次,点赞3次,收藏14次。在做数据统计页面时,总会遇到统计某段时间内,每天、每月、每年的数据视图(柱状图、折线图等)。这些统计数据一眼看过去也简单呀,不就是按照时间周期(天、月、年)对统计数据进行分个组就完了嘛?但是会有一个问题,简单的写个sql对周期分组,获取到的统计数据是缺失的,即没有数据的那天,整条记录也都没有了。如下图需求:以当前月份(2023年2月)为起点,往后倒推一年,查询之前一年里每个月的统计数据。可见图中的数据其实是缺少的,这条sql只查询到了有数据的月份(23年的1月、2月,22年的12月)_如何用一条sql查出按年按月按天的汇总
文章浏览阅读3.8k次,点赞66次,收藏51次。PostgreSQL全球开发小组与2022年10月13日,宣布发布PostgreSQL15,这是世界上最先进的开源数据库的最新版本_mysql8 postgresql15
文章浏览阅读1.3k次。上文介绍了磁盘管理器中VFD的实现原理,本篇将从上层角度讲解磁盘管理器的工作细节。_smgrrelationdata
文章浏览阅读1.1k次。PostgreSQL设置中文语言界面和局域网访问_postgressql汉化
文章浏览阅读4.2k次。PostgreSQL 修改数据存储路径_如何设置postgresql 数据目录
文章浏览阅读4.7k次。在项目中用到了多数据源,在连接postgres数据库时,项目启动报错,说数据库连接错误,说dual不存在,网上好多教程都是说数据库查询的时候的大小写问题,而这个仅仅是连接,咋鞥却处理方法是修改application-dev.yml中的配置文件.项目中的druid参数是这样的:确实在配置文件中有个查询语句。_relation "dual" does not exist
文章浏览阅读4.9k次。PostgreSQL是一款强大的关系型数据库,但在实际使用过程中,许多用户经常会遇到慢SQL的问题。这些问题不仅会降低数据库性能,还会直接影响业务流程和用户体验。因此,本文将会深入分析PostgreSQL慢SQL的原因和优化方案,帮助用户更好地利用这个优秀的数据库系统。无论你是初学者还是专业开发者,本文都将为你提供实用的技巧和方法,让你的PostgreSQL数据库始终保持高效快速。_postgresql数据库优化
文章浏览阅读1.6k次。Linux配置postgresql开机自启_linux 启动pgsql
文章浏览阅读2k次。本篇介绍如何在centos7系统搭建一个postgresql主备集群实现最近的HA(高可用)架构。后续更高级的HA模式都是基于这个最基本的主备搭建。_postgresql主备