Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions
Erik Rijkers <er@xs4all.nl>
Commits
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Tighten the concurrent abort check during decoding.
- 2ce353fc1902 14.0 landed
-
Improve hash_create()'s API for some added robustness.
- b3817f5f7746 14.0 landed
-
Use HASH_BLOBS for xidhash.
- a1b8aa1e4eec 14.0 landed
-
Fix initialization of RelationSyncEntry for streaming transactions.
- 69bd60672af6 14.0 landed
-
Remove unused function declaration in logicalproto.h.
- ddd5f6d2609b 14.0 landed
-
Add additional tests to test streaming of in-progress transactions.
- 58b5ae9d62bd 14.0 landed
-
Fix inline marking introduced in commit 464824323e.
- ac15b499f7f9 14.0 landed
-
Add support for streaming to built-in logical replication.
- 464824323e57 14.0 landed
-
Fix the SharedFileSetUnregister API.
- 4ab77697f67a 14.0 landed
-
Fix comment in procarray.c
- 77c7267c37f7 14.0 cited
-
Suppress compiler warning in non-cassert builds.
- e942af7b8261 14.0 cited
-
Extend the BufFile interface.
- 808e13b282ef 14.0 landed
-
Mark a few logical decoding related variables with PGDLLIMPORT.
- b48cac3b10a0 14.0 landed
-
Implement streaming mode in ReorderBuffer.
- 7259736a6e5b 14.0 landed
-
Extend the logical decoding output plugin API with stream methods.
- 45fdc9738b36 14.0 landed
-
WAL Log invalidations at command end with wal_level=logical.
- c55040ccd017 14.0 landed
-
Immediately WAL-log subtransaction and top-level XID association.
- 0bead9af484c 14.0 landed
-
Allow logical replication to transfer data in binary format.
- 9de77b545313 14.0 cited
-
Only superuser can set sslcert/sslkey in postgres_fdw user mappings
- cebf9d6e6ee1 13.0 cited
-
Track statistics for spilling of changes from ReorderBuffer.
- 9290ad198b15 13.0 landed
-
Add logical_decoding_work_mem to limit ReorderBuffer memory usage.
- cec2edfa7859 13.0 landed
-
logical decoding: process ASSIGNMENT during snapshot build
- bac2fae05c77 13.0 cited
-
Emit invalidations to standby for transactions without xid.
- c6ff84b06a68 9.6.0 cited
Attachments
- regression.diffs (text/x-diff) patch
On 2020-04-23 05:24, Dilip Kumar wrote: > On Wed, Apr 22, 2020 at 9:31 PM Erik Rijkers <er@xs4all.nl> wrote: >> >> The 'ddl' one is apparently not quite fixed - I get this in (cd >> contrib; make check)' (in both assert-enabled and non-assert-enabled >> build) > > Can you send me the contrib/test_decoding/regression.diffs file? Attached. Below is the patch list, in case that was unclear 20200422/v15-0001-Immediately-WAL-log-assignments.patch + 20200422/v15-0002-Issue-individual-invalidations-with-wal_level-lo.patch+ 20200422/v15-0003-Extend-the-output-plugin-API-with-stream-methods.patch+ 20200422/v15-0004-Gracefully-handle-concurrent-aborts-of-uncommitt.patch+ 20200422/v15-0005-Implement-streaming-mode-in-ReorderBuffer.patch + 20200422/v15-0006-Add-support-for-streaming-to-built-in-replicatio.patch+ 20200422/v15-0007-Track-statistics-for-streaming.patch + 20200422/v15-0008-Enable-streaming-for-all-subscription-TAP-tests.patch + 20200422/v15-0009-Add-TAP-test-for-streaming-vs.-DDL.patch + 20200422/v15-0010-Bugfix-handling-of-incomplete-toast-tuple.patch + 20200422/v15-0011-Provide-new-api-to-get-the-streaming-changes.patch + 20200414/bugfix_in_schema_sent.patch >> grep -A7 -B7 make.check_contrib.out: >> >> contrib/make.check_contrib.out-============== initializing database >> system ============== >> contrib/make.check_contrib.out-============== starting postmaster >> ============== >> contrib/make.check_contrib.out-running on port 64464 with PID 9175 >> contrib/make.check_contrib.out-============== creating database >> "contrib_regression" ============== >> contrib/make.check_contrib.out-CREATE DATABASE >> contrib/make.check_contrib.out-ALTER DATABASE >> contrib/make.check_contrib.out-============== running regression test >> queries ============== >> contrib/make.check_contrib.out:test ddl ... >> FAILED 840 ms >> contrib/make.check_contrib.out-test xact ... >> ok >> 24 ms >> contrib/make.check_contrib.out-test rewrite ... >> ok >> 187 ms >> contrib/make.check_contrib.out-test toast ... >> ok >> 851 ms >> contrib/make.check_contrib.out-test permissions ... >> ok >> 26 ms >> contrib/make.check_contrib.out-test decoding_in_xact ... >> ok >> 31 ms >> contrib/make.check_contrib.out-test decoding_into_rel ... >> ok >> 25 ms >> contrib/make.check_contrib.out-test binary ... >> ok >> 12 ms >> >> Otherwise patches apply and build OK so will go run some tests... > > Thanks > > > -- > Regards, > Dilip Kumar > EnterpriseDB: http://www.enterprisedb.com