RE: [PoC] pg_upgrade: allow to upgrade publisher node
Hayato Kuroda (Fujitsu) <kuroda.hayato@fujitsu.com>
From: "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
To: 'Amit Kapila' <amit.kapila16@gmail.com>
Cc: "Zhijie Hou (Fujitsu)" <houzj.fnst@fujitsu.com>, Peter Smith <smithpb2250@gmail.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>, Bruce Momjian <bruce@momjian.us>, Julien Rouhaud <rjuju123@gmail.com>, vignesh C <vignesh21@gmail.com>, Masahiko Sawada <sawada.mshk@gmail.com>, Dilip Kumar <dilipbalaut@gmail.com>
Date: 2023-09-13T13:52:17Z
Lists: pgsql-hackers
Dear Amit, Thank you for reviewing! Before making a patch I can reply the important point. > 1. One thing to note is that if user checks whether the old cluster is > upgradable with --check option and then try to upgrade, that will also > fail. Because during the --check run there would at least one > additional shutdown checkpoint WAL and then in the next run the slots > position won't match. Note, I am saying this in context of using > --check option with not-running old cluster. Won't that be surprising > to users? One possibility is that we document such a behaviour and > other is that we go back to WAL reading design where we can ignore > known WAL records like shutdown checkpoint, XLOG_RUNNING_XACTS, etc. Good catch, we have never considered the case that --check is executed for stopped cluster. You are right, the old cluster is turned on/off during the check and it generates SHUTDOWN_CHECKPOINT. This leads that confirmed_flush is behind the latest checkpoint lsn. Good catch, we have never considered the case that --check is executed for stopped cluster. You are right, the old cluster is turned on/off during the check and it generates SHUTDOWN_CHECKPOINT. This leads that confirmed_flush is behind the latest checkpoint lsn. Here are other approaches we came up with: 1. adds WARNING message when the --check is executed and slots are checked. We can say like: ``` ... Checking for valid logical replication slots WARNING: this check generated WALs Next pg_uprade would fail. Please ensure again that all WALs are replicated. ... ``` 2. adds hint message in the FATAL error when the confirmed_flush is not same as the latest checkpoint: ``` ... Checking for valid logical replication slots fatal Your installation contains invalid logical replication slots. These slots can't be copied, so this cluster cannot be upgraded. Consider removing such slots or consuming the pending WAL if any, and then restart the upgrade. If you did pg_upgrade --check before this run, it may be a cause. Please start clusters and confirm again that all changes are replicated. A list of invalid logical replication slots is in the file: ``` 3. requests users to do pg_upgrade --check on backup database, if old cluster has logical slots. Basically they save a whole of cluster before doing pg_uprade, so it may be acceptable. This is not a modification of codes. How do others think? Best Regards, Hayato Kuroda FUJITSU LIMITED
Commits
-
Fix issues in binary_upgrade_logical_slot_has_caught_up().
- 0bf62460bb9e 17.0 landed
-
Fix a random failure in 003_logical_slots.pl.
- 63c5df126abb 17.0 landed
-
Fix a test in 003_logical_slots.
- 3e36e48d8efe 17.0 landed
-
Fix uninitialized slot array access during the upgrade.
- a7db71ed2787 17.0 landed
-
Fix the test 003_logical_slots.
- 8af917be6bad 17.0 landed
-
Commit b195e6d482 forgot to update meson.build.
- 8949b978ff49 17.0 landed
-
Use shorter file names in the upgrade logical slots test.
- b195e6d482b8 17.0 landed
-
Migrate logical slots to the new node during an upgrade.
- 29d0a77fa660 17.0 landed
-
Flush logical slots to disk during a shutdown checkpoint if required.
- e0b2eed047df 17.0 landed
-
Prevent possibility of panics during shutdown checkpoint.
- c6c333436491 10.0 cited