Re: Support logical replication of DDLs

Zheng Li <zhengli10@gmail.com>

From: Zheng Li <zhengli10@gmail.com>

To: Amit Kapila <amit.kapila16@gmail.com>

Cc: Japin Li <japinli@hotmail.com>, Alvaro Herrera <alvherre@alvh.no-ip.org>, Dilip Kumar <dilipbalaut@gmail.com>, rajesh singarapu <rajesh.rs0541@gmail.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>

Date: 2022-05-13T21:01:33Z

Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →

Add a run_as_owner option to subscriptions.
- 482675987bcd 16.0 cited
Refactor pgoutput_change().
- da324d6cd45b 16.0 cited
Print the correct aliases for DML target tables in ruleutils.
- df931e9ab35b 11.20 landed
- c8a5f1685fb7 15.3 landed
- 4efb4f0d4878 13.11 landed
- 3dd287c14fac 12.15 landed
- 393430f57544 16.0 landed
- 14345f3c6a7b 14.8 landed
Fix object identity string for transforms
- 9a312562314a 16.0 landed
Add grantable MAINTAIN privilege and pg_maintain role.
- 60684dd834a2 16.0 cited
Get rid of recursion-marker values in enum AlterTableType
- 840ff5f451cd 16.0 cited
Release cache tuple when no longer needed
- ed0fbc8e5ac9 15.0 cited
Empty search_path in logical replication apply worker and walsender.
- 11da97024abb 14.0 cited
Refactor format_type APIs to be more modular
- a26116c6cbf4 11.0 cited
Use wrappers of PG_DETOAST_DATUM_PACKED() more.
- 3a0d473192b2 10.0 cited

Attachments

0005-Support-replication-of-CREATE-.-AS-.-and-SELECT-.-IN.patch (application/octet-stream) patch 0005
0002-Support-logical-logging-and-decoding-of-DDL-command-.patch (application/octet-stream) patch 0002
0003-Logical-replication-of-DDL-messages.patch (application/octet-stream) patch 0003
0004-Enable-replication-of-CREATE-MATERIALIZED-VIEW-AS-st.patch (application/octet-stream) patch 0004
0006-Add-couple-tests-for-DDL-replication-case.patch (application/octet-stream) patch 0006
0009-Support-replication-of-DDL-type-T_RenameStmt-table-r.patch (application/octet-stream) patch 0009
0001-Define-DDL-replication-levels-via-the-CREATE-PUBLICA.patch (application/octet-stream) patch 0001
0007-Enable-logging-and-replication-of-DDLs-executed-insi.patch (application/octet-stream) patch 0007
0008-Fail-replication-worker-on-DDL-command-that-rewrites.patch (application/octet-stream) patch 0008
0010-Handle-partitioned-table-creation-on-the-apply-worke.patch (application/octet-stream) patch 0010

> > 4. The handling related to partition tables seems missing because, on
> > the subscriber-side, it always creates a relation entry in
> > pg_subscription_rel which won't work. Check its interaction with
> > publish_via_partition_root.
>
> I will test it out.

Hi,

patch 0010 properly handles partitioned table creation on the apply
worker. Whether a replicated partitioned table should be added to
pg_subscription_rel catalog depends on the setting of
publish_via_partition_root of the publication. Thus we need to connect
to the source DB and check if the partitioned table is in
pg_catalog.pg_publication_tables after the apply worker creates the
partitioned table.

Thanks to Borui Yang for enabling and testing replication of DDL type
T_RenameStmt in patch 0009.

I've also rebased all the patches. Github branch of the same change
can be found here:
https://github.com/zli236/postgres/commits/ddl_replication

Regards,
Zheng