Re: Parallel CREATE INDEX for GIN indexes

Tomas Vondra <tomas.vondra@enterprisedb.com>

View thread

From: Tomas Vondra <tomas.vondra@enterprisedb.com>

To: Matthias van de Meent <boekewurm+postgres@gmail.com>

Cc: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>

Date: 2024-05-05T18:49:03Z

Lists: pgsql-hackers

Attachments

v20240505-0001-Allow-parallel-create-for-GIN-indexes.patch (text/x-patch) patch v20240505-0001
v20240505-0002-Use-mergesort-in-the-leader-process.patch (text/x-patch) patch v20240505-0002
v20240505-0003-Remove-the-explicit-pg_qsort-in-workers.patch (text/x-patch) patch v20240505-0003
v20240505-0004-Compress-TID-lists-before-writing-tuples-t.patch (text/x-patch) patch v20240505-0004
v20240505-0005-Collect-and-print-compression-stats.patch (text/x-patch) patch v20240505-0005
v20240505-0006-Enforce-memory-limit-when-combining-tuples.patch (text/x-patch) patch v20240505-0006
v20240505-0007-Detect-wrap-around-in-parallel-callback.patch (text/x-patch) patch v20240505-0007

Hi,

Here's a slightly improved version, fixing a couple bugs in handling
byval/byref values, causing issues on 32-bit machines (but not only).
And also a couple compiler warnings about string formatting.

Other than that, no changes.

-- 
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →

Exercise parallel GIN builds in regression tests
- f6e5d21bf73f 19 (unreleased) landed
- 32593394ee43 18.2 landed
Lookup the correct ordering for parallel GIN builds
- db14dcdec69d 19 (unreleased) landed
- eee71a66cc86 18.2 landed
Fix memory leak in _gin_parallel_merge
- 1681a70df3d6 18.0 landed
Enforce memory limit during parallel GIN builds
- b229c1016477 18.0 landed
Compress TID lists when writing GIN tuples to disk
- 0b2a45a5d1f2 18.0 landed
Allow parallel CREATE INDEX for GIN indexes
- 8492feb98f6d 18.0 landed