Re: Unnecessary delay in streaming replication due to replay lag

Asim Praveen <pasim@vmware.com>

From: Asim Praveen <pasim@vmware.com>

To: PostgreSQL mailing lists <pgsql-hackers@postgresql.org>

Cc: Michael Paquier <michael@paquier.xyz>, "Hao Wu (Pivotal)" <hawu@pivotal.io>

Date: 2020-08-09T05:54:32Z

Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →

Generate GUC tables from .dat file
- 63599896545c 19 (unreleased) cited
Skip WAL recycling and preallocation during archive recovery.
- cc2c7d65fc27 15.0 cited
Fix scenario where streaming standby gets stuck at a continuation record.
- 066871980183 11.0 cited

Attachments

v2-0001-Start-WAL-receiver-before-startup-process-replays.patch (application/octet-stream) patch v2-0001

I would like to revive this thready by submitting a rebased patch to start streaming replication without waiting for startup process to finish replaying all WAL.  The start LSN for streaming is determined to be the LSN that points to the beginning of the most recently flushed WAL segment.

The patch passes tests under src/test/recovery and top level “make check”.