Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions
Tomas Vondra <tomas.vondra@2ndquadrant.com>
Commits
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Tighten the concurrent abort check during decoding.
- 2ce353fc1902 14.0 landed
-
Improve hash_create()'s API for some added robustness.
- b3817f5f7746 14.0 landed
-
Use HASH_BLOBS for xidhash.
- a1b8aa1e4eec 14.0 landed
-
Fix initialization of RelationSyncEntry for streaming transactions.
- 69bd60672af6 14.0 landed
-
Remove unused function declaration in logicalproto.h.
- ddd5f6d2609b 14.0 landed
-
Add additional tests to test streaming of in-progress transactions.
- 58b5ae9d62bd 14.0 landed
-
Fix inline marking introduced in commit 464824323e.
- ac15b499f7f9 14.0 landed
-
Add support for streaming to built-in logical replication.
- 464824323e57 14.0 landed
-
Fix the SharedFileSetUnregister API.
- 4ab77697f67a 14.0 landed
-
Fix comment in procarray.c
- 77c7267c37f7 14.0 cited
-
Suppress compiler warning in non-cassert builds.
- e942af7b8261 14.0 cited
-
Extend the BufFile interface.
- 808e13b282ef 14.0 landed
-
Mark a few logical decoding related variables with PGDLLIMPORT.
- b48cac3b10a0 14.0 landed
-
Implement streaming mode in ReorderBuffer.
- 7259736a6e5b 14.0 landed
-
Extend the logical decoding output plugin API with stream methods.
- 45fdc9738b36 14.0 landed
-
WAL Log invalidations at command end with wal_level=logical.
- c55040ccd017 14.0 landed
-
Immediately WAL-log subtransaction and top-level XID association.
- 0bead9af484c 14.0 landed
-
Allow logical replication to transfer data in binary format.
- 9de77b545313 14.0 cited
-
Only superuser can set sslcert/sslkey in postgres_fdw user mappings
- cebf9d6e6ee1 13.0 cited
-
Track statistics for spilling of changes from ReorderBuffer.
- 9290ad198b15 13.0 landed
-
Add logical_decoding_work_mem to limit ReorderBuffer memory usage.
- cec2edfa7859 13.0 landed
-
logical decoding: process ASSIGNMENT during snapshot build
- bac2fae05c77 13.0 cited
-
Emit invalidations to standby for transactions without xid.
- c6ff84b06a68 9.6.0 cited
On 03/03/2018 02:37 AM, David Steele wrote: > On 3/2/18 8:01 PM, Andres Freund wrote: >> On 2018-03-03 02:00:46 +0100, Tomas Vondra wrote: >>> That is somewhat misleading, I think. You're right the last version was >>> submitted on 2018-01-19, but the next review arrived on 2018-01-31, i.e. >>> right at the end of the CF. So it's not like the patch was sitting there >>> with unresolved issues. Based on that review the patch was marked as RWF >>> and thus not moved to 2018-03 automatically. >> >> I don't see how this changes anything. > > I agree that things could be clearer, and Andres has produced a great > document that we can build on. The old one had gotten a bit stale. > > However, I think it's pretty obvious that a CF entry should be > accompanied with a patch. It sounds like the timing was awkward but > you still had 28 days to produce a new patch. > Based on internal discussion I'm not so sure about the "pretty obvious" part. It certainly wasn't that obvious to me, otherwise I'd submit the revised patch earlier - hindsight is 20/20. > I also notice that you submitted 7 patches in this CF but are > reviewing zero. > I've volunteered to review a couple of patches at the FOSDEM Developer Meeting - I thought Stephen was entering that into the CF app, not sure where it got lost. regards -- Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services