Re: removal of dangling temp tables
Michael Paquier <michael@paquier.xyz>
From: Michael Paquier <michael@paquier.xyz>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Alvaro Herrera <alvherre@2ndquadrant.com>, Robert Haas <robertmhaas@gmail.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2018-12-16T06:58:47Z
Lists: pgsql-hackers
On Sat, Dec 15, 2018 at 09:51:31AM -0500, Tom Lane wrote: > Alvaro Herrera <alvherre@2ndquadrant.com> writes: >> Oh, we already have it! Sorry, I overlooked it. With that, it seems >> the patch is fairly simple ... I wonder about the locking implications >> in autovacuum, though -- the value is set in backends without acquiring >> a lock. > > I was wondering about that too. But I think it's probably OK. If > autovacuum observes that (a) a table is old enough to pose a wraparound > hazard and (b) its putatively owning backend hasn't yet set > tempNamespaceId, then I think it's safe to conclude that that table is > removable, despite the theoretical race condition. This relies on the fact that the flag gets set by a backend within a transaction context, and autovacuum would not see yet temp relations associated to it at the moment of the scan of pg_class if the backend has not committed yet its namespace creation via the creation of the first temp table it uses. > Autovacuum would need to acquire a deletion lock and then check that the > table is still there, to avoid race conditions if the backend starts to > clean out the schema immediately after it looks. But I think those race > conditions exist anyway (consider a fresh backend that starts cleaning out > its temp schema immediately), so if we have a problem with concurrent > deletion attempts then that problem exists already. > >> I wonder how this thing works in parallel query workers. > > Surely workers are not allowed to create or delete temp tables. Yes, InitTempTableNamespace prevents their creation and InitLocalBuffers prevents their access as buffers of temp tables are local to a backend and cannot be shared across multiple workers. Amit Kapila has been working on this problem lately for example. -- Michael
Commits
-
Have DISCARD ALL/TEMP remove leftover temp tables
- b7258a30aa6f 9.5.16 landed
- aa2e84d2cc8d 9.6.12 landed
- 3c4ca21093b5 10.7 landed
- 2602838fa338 9.4.21 landed
-
Make autovacuum more selective about temp tables to keep
- 5199abaca318 9.4.21 landed
- a85045cccb1b 9.5.16 landed
- a6ca47cd2f3f 10.7 landed
- 7fc2363a6158 9.6.12 landed
-
Make autovacuum more aggressive to remove orphaned temp tables
- 943576bddcb5 11.0 cited
-
autovacuum: Drop orphan temp tables more quickly but with more caution.
- a734fd5d1c30 10.0 cited