Re: Large files for relations

Thomas Munro <thomas.munro@gmail.com>

From: Thomas Munro <thomas.munro@gmail.com>

To: David Steele <david@pgmasters.net>

Cc: Peter Eisentraut <peter.eisentraut@enterprisedb.com>, Robert Haas <robertmhaas@gmail.com>, Dagfinn Ilmari Mannsåker <ilmari@ilmari.org>, Jim Mlodgenski <jimmy76@gmail.com>, pgsql-hackers <pgsql-hackers@postgresql.org>, Stephen Frost <sfrost@snowman.net>

Date: 2024-03-06T21:54:46Z

Lists: pgsql-hackers

Attachments

v3-0001-Allow-relation-segment-size-to-be-set-by-initdb.patch (application/x-patch) patch v3-0001

Rebased.  I had intended to try to get this into v17, but a couple of
unresolved problems came up while rebasing over the new incremental
backup stuff.  You snooze, you lose.  Hopefully we can sort these out
in time for the next commitfest:

* should pg_combinebasebackup read the control file to fetch the segment size?
* hunt for other segment-size related problems that may be lurking in
new incremental backup stuff
* basebackup_incremental.c wants to use memory in proportion to
segment size, which looks like a problem, and I wrote about that in a
new thread[1]

[1] https://www.postgresql.org/message-id/flat/CA%2BhUKG%2B2hZ0sBztPW4mkLfng0qfkNtAHFUfxOMLizJ0BPmi5%2Bg%40mail.gmail.com