Re: recovering from "found xmin ... from before relfrozenxid ..."
Andres Freund <andres@anarazel.de>
From: Andres Freund <andres@anarazel.de>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Amit Kapila <amit.kapila16@gmail.com>, Robert Haas <robertmhaas@gmail.com>, Ashutosh Sharma <ashu.coek88@gmail.com>, Mark Dilger <mark.dilger@enterprisedb.com>, Masahiko Sawada <masahiko.sawada@2ndquadrant.com>, "Andrey M. Borodin" <x4mmm@yandex-team.ru>, MBeena Emerson <mbeena.emerson@gmail.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>, Peter Eisentraut <peter.eisentraut@2ndquadrant.com>, Stephen Frost <sfrost@snowman.net>
Date: 2020-10-29T01:13:44Z
Lists: pgsql-hackers
Hi, On 2020-10-27 20:51:10 -0700, Andres Freund wrote: > On 2020-10-15 01:37:35 -0700, Andres Freund wrote: > > Attached is a *prototype* implemention of this concept, which clearly is > > lacking some comment work (and is intentionally lacking some > > re-indentation). > > > > I described my thoughts about how to limit the horizons for temp tables in > > https://www.postgresql.org/message-id/20201014203103.72oke6hqywcyhx7s%40alap3.anarazel.de > > Attached is an updated version of this patch. Quite a bit of polish, > added removal of the isTopLevel arguments added a7212be8b9e that are now > unnecessary, and changed the initialization of the temp table horizons > to be latestCompletedXid + 1 instead of just latestCompletedXid when no > xid is assigned. > > > > Besides comments this probably mainly needs a bit more tests around temp > > table vacuuming. Should have at least an isolation test that verifies > > that temp table rows can be a) vacuumed b) pruned away in the presence > > of other sessions with xids. > > I added an isolationtester test for this. It verifies that dead rows in > temp tables get vacuumed and pruned despite concurrent sessions having > older snapshots. It does so by forcing an IOS and checking the number of > heap fetches reported by EXPLAIN. I also added a companion test for > permanent relations, ensuring that such rows do not get removed. > > > Any comments? Otherwise I'll push that patch tomorrow. Just pushed this. Let's see what the BF says... It's kinda cool how much more aggressive hot pruning / killtuples now is for temp tables. Greetings, Andres Freund
Commits
-
Fix wrong data table horizon computation during backend startup.
- 1c7675a7a426 14.0 landed
-
Centralize horizon determination for temp tables, fixing bug due to skew.
- 94bc27b57680 14.0 landed
-
pg_surgery: Try to stabilize regression tests.
- 0811f766fd74 14.0 landed
-
New contrib module, pg_surgery, with heap surgery functions.
- 34a947ca13e5 14.0 landed
-
Set cutoff xmin more aggressively when vacuuming a temporary table.
- a7212be8b9e0 14.0 cited
-
snapshot scalability: Don't compute global horizons while building snapshots.
- dc7420c2c927 14.0 cited
-
Introduce vacuum errcontext to display additional information.
- b61d161c1463 13.0 cited