Re: Fwd: BUG #18016: REINDEX TABLE failure
Nathan Bossart <nathandbossart@gmail.com>
From: Nathan Bossart <nathandbossart@gmail.com>
To: Michael Paquier <michael@paquier.xyz>
Cc: Gurjeet Singh <gurjeet@singh.im>, Tom Lane <tgl@sss.pgh.pa.us>, Richard Veselý <richard.vesely@softea.sk>, pgsql-bugs@lists.postgresql.org
Date: 2023-07-28T18:00:56Z
Lists: pgsql-bugs, pgsql-hackers
On Fri, Jul 28, 2023 at 10:50:50AM +0900, Michael Paquier wrote: > On Thu, Jul 27, 2023 at 04:14:41PM -0700, Nathan Bossart wrote: >> On Wed, Jul 26, 2023 at 06:43:18PM -0700, Gurjeet Singh wrote: >>> I felt the need for that paragraph, because it doesn't feel obvious to >>> me as to why we can't simply reindex the toast table as the first >>> thing in this function; the toast table reindex will trigger CCI, and >>> that'd be bad if done before RelationGetIndexList(). >> >> I see. I'd suggest referencing the comment above the function, but in >> general I do think having a comment about this is appropriate. > > + * This should be done after the suppression of the use of indexes (above), > + * because the recursive call to reindex_relation() below will invoke > + * CommandCounterIncrement(), which may prevent enumeration of the indexes > + * on the table. > > This does not explain the reason why this would prevent the creation > of a consistent index list fetched from the parent table, does it? > Would some indexes be missing from what should be reindexed? Or some > added unnecessarily? Would that be that an incorrect list? IIUC the issue is that something (e.g., VACUUM FULL, CLUSTER) might've just rebuilt the heap, so if we CCI'd before gathering the list of indexes, the new heap contents would become visible, and the indexes would be inconsistent with the heap. This is a problem when the relation in question is a system catalog that needs to be consulted to gather the list of indexes. To handle this, we avoid the CCI until after gathering the indexes so that the old heap contents appear valid and can be used as needed. Once that is done, we mark the indexes as pending-rebuild and do a CCI, at which point the indexes become inconsistent with the heap. This behavior appears to have been added by commit b9b8831. -- Nathan Bossart Amazon Web Services: https://aws.amazon.com
Commits
Same data as JSON:
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Reindex toast before its main relation in reindex_relation()
- f2bf8fb04886 17.0 landed
-
Fix comment in index.c
- bd5760df38c0 17.0 landed
-
Clean up a bug in sql/json items commit 66ea94e8e6
- 06a66d87dbc7 17.0 cited
-
Create a "relation mapping" infrastructure to support changing the relfilenodes
- b9b8831ad60f 9.0.0 cited