RE: Potential data loss due to race condition during logical replication slot creation
Hayato Kuroda (Fujitsu) <kuroda.hayato@fujitsu.com>
From: "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
To: 'Amit Kapila' <amit.kapila16@gmail.com>
Cc: Masahiko Sawada <sawada.mshk@gmail.com>, "Callahan, Drew" <callaan@amazon.com>, "pgsql-bugs@lists.postgresql.org" <pgsql-bugs@lists.postgresql.org>
Date: 2024-03-19T02:16:35Z
Lists: pgsql-bugs
Attachments
- 0001-Serialize-running-xacts.patch (application/octet-stream) patch 0001
Dear Amit, > I feel setting "needs_full_snapshot" to true for decoding means the > snapshot will start tracking non-catalog committed xacts as well which > is costly. I think the approach was most conservative one which does not have to change the version of the snapshot. However, I understood that you wanted to consider the optimized solution for HEAD first. > See SnapBuildCommitTxn(). Can we avoid this problem if we > would have list of all running xacts when we serialize the snapshot by > not decoding any xact whose xid lies in that list? If so, one idea to > achieve could be that we maintain the highest_running_xid while > serailizing the snapshot and then during restore if that > highest_running_xid is <= builder->initial_xmin_horizon, then we > ignore restoring the snapshot. We already have few such cases handled > in SnapBuildRestore(). Based on the idea, I made a prototype. It can pass tests added by others and me. How do other think? Best Regards, Hayato Kuroda FUJITSU LIMITED https://www.fujitsu.com/
Commits
-
Fix possibility of logical decoding partial transaction changes.
- bb19b70081e2 18.0 landed
- 068674f4ab44 17.0 landed
- 2f3304ce133f 16.4 landed
- aee8c2b95492 15.8 landed
- f7d3caf9ddbf 14.13 landed
- cf2c69ec5a5b 13.16 landed
- 1b370758770c 12.20 landed