Re: recovering from "found xmin ... from before relfrozenxid ..."
Tom Lane <tgl@sss.pgh.pa.us>
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Robert Haas <robertmhaas@gmail.com>
Cc: Amit Kapila <amit.kapila16@gmail.com>,
Ashutosh Sharma <ashu.coek88@gmail.com>,
Mark Dilger <mark.dilger@enterprisedb.com>,
Masahiko Sawada <masahiko.sawada@2ndquadrant.com>,
"Andrey M. Borodin" <x4mmm@yandex-team.ru>,
MBeena Emerson <mbeena.emerson@gmail.com>,
PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>,
Andres Freund <andres@anarazel.de>,
Peter Eisentraut <peter.eisentraut@2ndquadrant.com>,
Stephen Frost <sfrost@snowman.net>
Date: 2020-09-21T20:22:17Z
Lists: pgsql-hackers
Robert Haas <robertmhaas@gmail.com> writes: > On Mon, Sep 21, 2020 at 2:21 PM Tom Lane <tgl@sss.pgh.pa.us> wrote: >> Right, but what we end up with is that the very same tuple xmin and >> xmax might result in pruning/deletion, or not, depending on whether >> it's part of a HOT chain or not. That's at best pretty weird, and >> at worst it means that corner-case bugs in other places are triggered >> in only one of the two scenarios ... which is what we have here. > I'm not sure I really understand how that's happening, because surely > HOT chains and non-HOT chains are pruned by the same code, but it > doesn't sound good. No, they're not. lazy_scan_heap() will never remove a tuple that is HeapTupleIsHotUpdated or HeapTupleIsHeapOnly, even if it thinks it's DEAD -- cf. vacuumlazy.c, about line 1350. So tuples in a HOT chain are deleted exactly when pruneheap.c sees fit to do so. OTOH, for tuples not in a HOT chain, the decision is (I believe) entirely on lazy_scan_heap(). And the core of my complaint is that pruneheap.c's decisions about what is DEAD are not reliably identical to what HeapTupleSatisfiesVacuum thinks. I don't mind if a free-standing prune operation has its own rules, but when it's invoked by VACUUM it ought to follow VACUUM's rules about what is dead or alive. What remains unclear at this point is whether we ought to import some of the intelligence added by the GlobalVisState patch into VACUUM's behavior, or just dumb down pruneheap.c so that it applies exactly the HeapTupleSatisfiesVacuum rules when invoked by VACUUM. regards, tom lane
Commits
-
Fix wrong data table horizon computation during backend startup.
- 1c7675a7a426 14.0 landed
-
Centralize horizon determination for temp tables, fixing bug due to skew.
- 94bc27b57680 14.0 landed
-
pg_surgery: Try to stabilize regression tests.
- 0811f766fd74 14.0 landed
-
New contrib module, pg_surgery, with heap surgery functions.
- 34a947ca13e5 14.0 landed
-
Set cutoff xmin more aggressively when vacuuming a temporary table.
- a7212be8b9e0 14.0 cited
-
snapshot scalability: Don't compute global horizons while building snapshots.
- dc7420c2c927 14.0 cited
-
Introduce vacuum errcontext to display additional information.
- b61d161c1463 13.0 cited