Re: Trying out libarchive for reading user-generated WAL tarballs

Thomas Munro <thomas.munro@gmail.com>

From: Thomas Munro <thomas.munro@gmail.com>

To: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>

Date: 2026-04-10T06:33:30Z

Lists: pgsql-hackers

Attachments

v2-0001-Provide-astreamer_plain_reader-for-reading-files.patch (text/x-patch) patch v2-0001
v2-0002-pg_waldump-Read-data-with-astreamer_plain_reader.patch (text/x-patch) patch v2-0002
v2-0003-libarchive-Add-configure-and-meson-options.patch (text/x-patch) patch v2-0003
v2-0004-libarchive-Provide-astreamer_libarchive_reader.patch (text/x-patch) patch v2-0004
v2-0005-fixup-Use-more-efficient-zero-copy-API.patch (text/x-patch) patch v2-0005
v2-0006-pg_waldump-Use-astreamer_libarchive_reader.patch (text/x-patch) patch v2-0006

On Sun, Apr 5, 2026 at 2:42 PM Thomas Munro <thomas.munro@gmail.com> wrote:
> Perhaps that could be fixed if astreamer_file.c provided
> "astreamer_file_reader" with the same semantics, so that it could
> unconditionally call astreamer_pull(privateInfo->archive_streamer),
> instead of doing the read, push-into-stream itself?  Just a thought.

That seems to work.