Re: Revisiting {CREATE INDEX, REINDEX} CONCURRENTLY improvements
Mihail Nikalayeu <michail.nikolaev@gmail.com>
From: Michail Nikolaev <michail.nikolaev@gmail.com>
To: Matthias van de Meent <boekewurm+postgres@gmail.com>
Cc: Michael Paquier <michael@paquier.xyz>,
PostgreSQL Hackers <pgsql-hackers@postgresql.org>, Andrey Borodin <amborodin86@gmail.com>,
Melanie Plageman <melanieplageman@gmail.com>
Date: 2025-01-08T02:12:00Z
Lists: pgsql-hackers
Commits
Same data as JSON:
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Revert changes to CONCURRENTLY that "sped up" Xmin advance
- e28bb8851969 15.0 cited
-
VACUUM: ignore indexing operations with CONCURRENTLY
- d9d076222f5b 14.0 cited
-
Avoid spurious waits in concurrent indexing
- c98763bf51bf 14.0 cited
Attachments
- v11-0008-Concurrently-built-index-validation-uses-fresh-s.patch (application/octet-stream) patch v11-0008
- v11-0010-Add-proper-handling-of-auxiliary-indexes-during-.patch (application/octet-stream) patch v11-0010
- v11-0011-Updates-index-insert-and-value-computation-logic.patch (application/octet-stream) patch v11-0011
- v11-0009-Remove-PROC_IN_SAFE_IC-optimization.patch (application/octet-stream) patch v11-0009
- v11-0007-Improve-CREATE-REINDEX-INDEX-CONCURRENTLY-using-.patch (application/octet-stream) patch v11-0007
- v11-0006-Add-STIR-Short-Term-Index-Replacement-access-met.patch (application/octet-stream) patch v11-0006
- v11-0003-Allow-advancing-xmin-during-non-unique-non-paral.patch (application/octet-stream) patch v11-0003
- v11-0005-Allow-snapshot-resets-in-concurrent-unique-index.patch (application/octet-stream) patch v11-0005
- v11-0004-Allow-snapshot-resets-during-parallel-concurrent.patch (application/octet-stream) patch v11-0004
- v11-0002-Add-stress-tests-for-concurrent-index-operations.patch (application/octet-stream) patch v11-0002
- v11-0001-This-is-https-commitfest.postgresql.org-50-5160-.patch (application/octet-stream) patch v11-0001
Hello, everyone! Some updates: * Rebased. * Resolved the issue with integer overflow in memory calculation, which caused a performance drop during sorting. * Fixed a broken tag in the documentation. * Added per-tuple progress tracking in the validation phase. Additionally, the anomaly with the GIST index has been clarified. It occurs because the first phase is slow, and many tuples need to be inserted during the validation phase. For each tuple, heapam_index_fetch_tuple is called, even for those on the same page. It might be possible to implement a batched version of heapam_index_fetch_tuple to handle multiple tuples on the same page and mitigate this issue. Best regards, Mikhail.