Re: Skipping logical replication transactions on subscriber side

Masahiko Sawada <sawada.mshk@gmail.com>

From: Masahiko Sawada <sawada.mshk@gmail.com>

To: Greg Nancarrow <gregn4422@gmail.com>

Cc: Amit Kapila <amit.kapila16@gmail.com>, "houzj.fnst@fujitsu.com" <houzj.fnst@fujitsu.com>, "tanghy.fnst@fujitsu.com" <tanghy.fnst@fujitsu.com>, "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>, Alexey Lesovsky <lesovsky@gmail.com>, Peter Eisentraut <peter.eisentraut@enterprisedb.com>, PostgreSQL-development <pgsql-hackers@postgresql.org>

Date: 2021-10-21T04:59:17Z

Lists: pgsql-hackers

Attachments

v18-0003-Add-skip_xid-option-to-ALTER-SUBSCRIPTION.patch (application/octet-stream) patch v18-0003
v18-0002-Add-RESET-command-to-ALTER-SUBSCRIPTION-command.patch (application/octet-stream) patch v18-0002
v18-0001-Add-a-subscription-worker-statistics-view-pg_sta.patch (application/octet-stream) patch v18-0001

On Wed, Oct 20, 2021 at 12:33 PM Greg Nancarrow <gregn4422@gmail.com> wrote:
>
> On Mon, Oct 18, 2021 at 12:34 PM Masahiko Sawada <sawada.mshk@gmail.com> wrote:
> >
> > I've attached updated patches that incorporate all comments I got so far.
> >
>
> Minor comment on patch 17-0003

Thank you for the comment!

>
> src/backend/replication/logical/worker.c
>
> (1) Typo in apply_handle_stream_abort() comment:
>
> /* Stop skipping transaction transaction, if enabled */
> should be:
> /* Stop skipping transaction changes, if enabled */

Fixed.

I've attached updated patches. In this version, in addition to the
review comments I go so far, I've changed the view name from
pg_stat_subscription_errors to pg_stat_subscription_workers as per the
discussion on including xact info to the view on another thread[1].
I’ve also changed related codes accordingly.

Regards,

[1] https://www.postgresql.org/message-id/CAD21AoDF7LmSALzMfmPshRw_xFcRz3WvB-me8T2gO6Ht%3D3zL2w%40mail.gmail.com

--
Masahiko Sawada
EDB:  https://www.enterprisedb.com/

Commits

Test ALIGNOF_DOUBLE==4 compatibility under ALIGNOF_DOUBLE==8.
- c1da0acbb06e 15.0 landed
Reorder subskiplsn in pg_subscription to avoid alignment issues.
- 79b716cfb7a1 15.0 landed
Add ALTER SUBSCRIPTION ... SKIP.
- 208c5d65bbd6 15.0 landed
Optionally disable subscriptions on error.
- 705e20f8550c 15.0 cited
Update docs of logical replication for commit 8d74fc96db.
- 85c61ba8920b 15.0 landed
Respect permissions within logical replication.
- a2ab9c06ea15 15.0 cited
Fix regression test failure caused by commit 8d74fc96db.
- 41e66fee0516 15.0 landed
Add a view to show the stats of subscription workers.
- 8d74fc96db5f 15.0 landed
Add logical change details to logical replication worker errcontext.
- abc0910e2e0a 15.0 landed
Rename LOGICAL_REP_MSG_STREAM_END to LOGICAL_REP_MSG_STREAM_STOP.
- 4cd7a1896871 15.0 landed
Fix typo in protocol.sgml.
- e1915646658d 14.0 landed
- 0ac1aee0d7d8 15.0 landed
Remove unused argument in apply_handle_commit_internal().
- f4b939f1a372 14.0 landed
- 16bd4becee32 15.0 landed
Fix replication of in-progress transactions in tablesync worker.
- 0926e96c4934 14.0 cited
Reorder pg_sequence columns to avoid alignment issue
- f3b421da5f4a 10.0 cited