Skip to content

Необходимость выполнения FULL после смены Timeline для бэкапов PAGE #369

@triwada

Description

@triwada

Согласно документации https://postgrespro.ru/docs/enterprise/9.6/app-pgprobackup

Настройка непрерывного архивирования WAL

Для выполнения копирования в режиме PAGE, восстановления на момент времени, создания резервных копий с использованием режима доставки WAL ARCHIVE и восстановления инкрементальной копии после смены линии времени, должно осуществляться непрерывное архивирование WAL. Чтобы настроить непрерывное архивирование, выполните следующие действия:

Означает ли это, что бэкапы PAGE при выполнении требований из этого раздела документации должны без проблем выполняться после смены Timeline?

В нашем случае это не соблюдается

$ pg_probackup -V
pg_probackup 2.4.10 (Postgres Pro 9.6.18.1 enterprise)


лого бэкапа PAGE

2021-04-18 22:10:01 MSK [72767]: INFO: command: pg_probackup backup -B /pgdump/backup --instance dummy -U backup -b PAGE -j 30 --delete-expired --delete-wal --log-filename=20210418_pg_probackup_delta.log --error-log-filename=20210418_pg_probackup_delta.log --log-directory=/home/postgres/logs/backup --log-level-file=INFO --log-level-console=OFF
2021-04-18 22:10:01 MSK [72767]: INFO: Backup start, pg_probackup version: 2.4.10, instance: dummy, backup ID: QRRX8P, backup mode: PAGE, wal mode: ARCHIVE, remote: false, compress-algorithm: zlib, compress-level: 1
2021-04-18 22:10:01 MSK [72767]: WARNING: Current PostgreSQL role is superuser. It is not recommended to run backup or checkdb as superuser.
2021-04-18 22:10:01 MSK [72767]: INFO: Backup QRRX8P is going to be taken from standby
2021-04-18 22:10:01 MSK [72767]: WARNING: Valid backup on current timeline 161 is not found, trying to look up on previous timelines
2021-04-18 22:10:09 MSK [72767]: WARNING: unexpected WAL file name "nohup.out"
2021-04-18 22:10:09 MSK [72767]: WARNING: Cannot find valid backup on previous timelines
2021-04-18 22:10:09 MSK [72767]: ERROR: Create new full backup before an incremental one
2021-04-18 22:10:09 MSK [72767]: ERROR: Create new full backup before an incremental one
2021-04-18 22:10:09 MSK [72767]: WARNING: backup in progress, stop backup
2021-04-18 22:10:09 MSK [72767]: WARNING: Backup QRRX8P is running, setting its status to ERROR


pg_probackup show -B /pgdump/backup --instance dummy

BACKUP INSTANCE 'dummy'
======================================================================================================================================================
 Instance  Version  ID      Recovery Time           Mode  WAL Mode  TLI         Time    Data     WAL  Zratio  Start LSN       Stop LSN        Status
======================================================================================================================================================
 dummy   9.6      QRRYQW  ----                    FULL  STREAM    161/0      3h:5m  1041GB       0    4.62  2705C/1B7BF0C8  0/0             RUNNING
 dummy   9.6      QRRX8P  ----                    PAGE  ARCHIVE   161/0         8s       0       0    1.00  2705B/2031BBD8  0/0             ERROR
 dummy   9.6      QRRROP  ----                    PAGE  ARCHIVE   161/0         8s       0       0    1.00  27055/F3979E50  0/0             ERROR
 dummy   9.6      QRRM4R  ----                    PAGE  ARCHIVE   161/0        11s       0       0    1.00  27051/6B70BC18  0/0             ERROR
 dummy   9.6      QRRGKP  ----                    PAGE  ARCHIVE   161/0        10s       0       0    1.00  2704C/B8910578  0/0             ERROR
 dummy   9.6      QRRB0P  ----                    PAGE  ARCHIVE   161/0         8s       0       0    1.00  27049/488247E0  0/0             ERROR
 dummy   9.6      QRR5GP  ----                    PAGE  ARCHIVE   161/0         8s       0       0    1.00  27045/706D20B8  0/0             ERROR
 dummy   9.6      QRQZWR  ----                    PAGE  ARCHIVE   161/0         7s       0       0    1.00  27042/64626D28  0/0             ERROR
 dummy   9.6      QRQUCP  ----                    PAGE  ARCHIVE   161/0         8s       0       0    1.00  2703E/BE8F2E8   0/0             ERROR
 dummy   9.6      QRQOSQ  ----                    PAGE  ARCHIVE   161/0         7s       0       0    1.00  27039/EF97B408  0/0             ERROR
 dummy   9.6      QRQJ8Q  ----                    PAGE  ARCHIVE   161/0        10s       0       0    1.00  27037/1904B928  0/0             ERROR
 dummy   9.6      QRQ2KP  2021-04-17 22:14:34+03  PAGE  ARCHIVE   160/160   8m:47s    20GB  6784MB    2.97  27033/DB00A5E8  27035/8397FB68  OK
 dummy   9.6      QRPX0P  2021-04-17 20:23:48+03  PAGE  ARCHIVE   160/160  13m:52s    21GB    27GB    3.04  2701B/BD09CD58  27022/747C9220  OK
 dummy   9.6      QRPRGQ  2021-04-17 18:35:14+03  PAGE  ARCHIVE   160/160  25m:18s    31GB    32GB    3.16  27003/9F0CAAD0  2700B/A8F3CC88  OK
 dummy   9.6      QRPLWP  2021-04-17 16:24:07+03  PAGE  ARCHIVE   160/160  14m:28s    27GB    56GB    3.22  26FC7/5401D5B8  26FD5/5EBE18F8  OK
 dummy   9.6      QRPGCR  2021-04-17 14:18:25+03  PAGE  ARCHIVE   160/160   8m:29s    22GB    13GB    3.13  26FAA/B00BAA0   26FAD/56ABF910  OK
 dummy   9.6      QRPASP  2021-04-17 12:19:10+03  PAGE  ARCHIVE   160/160   9m:15s    21GB    13GB    3.25  26F98/D107A728  26F9C/1E437A50  OK
 dummy   9.6      QRP58P  2021-04-17 10:19:42+03  PAGE  ARCHIVE   160/160   9m:47s    20GB    13GB    3.19  26F87/9700C3E0  26F8A/BDB0C968  OK
 dummy   9.6      QROZOQ  2021-04-17 08:14:32+03  PAGE  ARCHIVE   160/160   4m:41s    13GB    13GB    2.99  26F72/EB642830  26F76/39499C90  OK
 dummy   9.6      QROU4S  2021-04-17 06:15:04+03  PAGE  ARCHIVE   160/160    5m:5s    17GB    13GB    3.25  26F6A/850103F0  26F6D/BAF1A778  OK
 dummy   9.6      QROOKS  2021-04-17 04:14:36+03  PAGE  ARCHIVE   160/160   4m:41s    14GB    12GB    2.94  26F60/78002800  26F63/8739D028  OK
 dummy   9.6      QROJ0P  2021-04-17 02:33:18+03  PAGE  ARCHIVE   160/160  23m:22s    30GB    18GB    3.53  26F59/A6015F88  26F5E/6FCF8D0   OK
 dummy   9.6      QRNWSP  2021-04-17 01:28:24+03  PAGE  ARCHIVE   160/160   7h:18m    47GB   317GB    3.44  26F0A/681EC4E8  26F59/AA15F008  OK
 dummy   9.6      QRNAKQ  2021-04-16 15:26:42+03  PAGE  ARCHIVE   160/160    7h:5m    49GB  1158GB    3.46  26D7F/E812C658  26EA1/67123530  OK
 dummy   9.6      QRMD8Q  2021-04-16 07:51:40+03  PAGE  ARCHIVE   160/160   10h:8m    61GB   794GB    3.79  26C59/55002840  26D1F/EE237668  OK
 dummy   9.6      QRKQG1  2021-04-15 20:22:08+03  FULL  STREAM    160/0    19h:23m    10TB  1883GB    2.39  26A6E/600094E0  26C45/1FEE6C80  OK

При этом на другой реплике этого же инстанса бэкапы PAGE выполняются без проблем даже после смены Timeline


BACKUP INSTANCE 'dummy'
======================================================================================================================================================
 Instance  Version  ID      Recovery Time           Mode  WAL Mode  TLI         Time    Data      WAL  Zratio  Start LSN       Stop LSN        Status
======================================================================================================================================================
 dummy   9.6      QRS84D  2021-04-19 02:07:57+03  PAGE  ARCHIVE   161/161    3m:9s    10GB   9296MB    3.59  27064/59903DF8  27066/9E2FB1A8  OK
 dummy   9.6      QRS2KD  2021-04-19 00:07:37+03  PAGE  ARCHIVE   161/161   2m:46s  7549MB   6512MB    3.34  2705F/C8D6C070  27061/5F54BC40  OK
 dummy   9.6      QRRX0E  2021-04-18 22:07:42+03  PAGE  ARCHIVE   161/161   2m:47s  8226MB   4976MB    4.08  2705B/2031BBD8  2705C/57CFFF18  OK
 dummy   9.6      QRRRGD  2021-04-18 20:07:34+03  PAGE  ARCHIVE   161/161   2m:44s  8224MB   7808MB    3.72  27055/F3979E50  27057/DB99A5C8  OK
 dummy   9.6      QRRLWD  2021-04-18 18:07:25+03  PAGE  ARCHIVE   161/161   2m:36s  8900MB   5952MB    3.74  27051/6B70BC18  27052/DF793480  OK
 dummy   9.6      QRRGCE  2021-04-18 16:07:35+03  PAGE  ARCHIVE   161/161   2m:43s  6744MB   6544MB    3.74  2704C/B8910578  2704E/512BD068  OK
 dummy   9.6      QRRASD  2021-04-18 14:07:59+03  PAGE  ARCHIVE   161/161   3m:13s  9364MB   4192MB    3.55  27049/488247E0  2704A/4E1B9430  OK
 dummy   9.6      QRR58D  2021-04-18 12:07:33+03  PAGE  ARCHIVE   161/161   2m:46s  7726MB   5488MB    3.56  27045/706D20B8  27046/C7143D38  OK
 dummy   9.6      QRQZOD  2021-04-18 10:08:00+03  PAGE  ARCHIVE   161/161   3m:11s    12GB   3264MB    3.35  27042/64626D28  27043/3057AF00  OK
 dummy   9.6      QRQU4D  2021-04-18 08:08:28+03  PAGE  ARCHIVE   161/161   3m:35s    11GB   6432MB    4.74  2703E/BE8F2E8   2703F/9D202868  OK
 dummy   9.6      QRQOKD  2021-04-18 06:07:35+03  PAGE  ARCHIVE   161/161   2m:39s  7795MB   7056MB    5.37  27039/EF97B408  2703B/A8D45538  OK
 dummy   9.6      QRQJ0D  2021-04-18 04:06:53+03  PAGE  ARCHIVE   161/160    3m:9s  9595MB    384MB    3.46  27037/1904B928  27037/31002478  OK
 dummy   9.6      QRQDGD  ----                    PAGE  ARCHIVE   160/160   1h:29m   892MB        0    1.91  27036/D0000028  0/0             ERROR
 dummy   9.6      QRQ7WD  ----                    PAGE  ARCHIVE   160/160    1h:0m       0        0    1.00  27036/D0000028  0/0             ERROR
... обрезано много записей
 dummy   9.6      QRDESE  2021-04-11 02:16:05+03  PAGE  ARCHIVE   160/160   12m:7s  8008MB   3616MB    2.80  267EE/39AE0C28  267EF/1BFE6608  OK
 dummy   9.6      QRD98D  2021-04-11 00:56:20+03  PAGE  ARCHIVE   160/160  52m:28s    66GB   9776MB    5.26  267EB/38DDBE40  267ED/9B261708  OK
 dummy   9.6      QRBRJB  2021-04-10 21:35:32+03  FULL  STREAM    160/0    16h:51m    10TB    173GB    2.39  267BC/4EE0AB18  267E7/89C72A70  OK

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions