Re: Column Filtering in Logical Replication

Amit Kapila <amit.kapila16@gmail.com>

From: Amit Kapila <amit.kapila16@gmail.com>

To: Tomas Vondra <tomas.vondra@enterprisedb.com>

Cc: Peter Eisentraut <peter.eisentraut@enterprisedb.com>, "houzj.fnst@fujitsu.com" <houzj.fnst@fujitsu.com>, Alvaro Herrera <alvherre@alvh.no-ip.org>, Justin Pryzby <pryzby@telsasoft.com>, Rahila Syed <rahilasyed90@gmail.com>, Peter Smith <smithpb2250@gmail.com>, pgsql-hackers <pgsql-hackers@postgresql.org>, "shiy.fnst@fujitsu.com" <shiy.fnst@fujitsu.com>

Date: 2022-03-25T03:10:04Z

Lists: pgsql-hackers

On Fri, Mar 25, 2022 at 5:44 AM Tomas Vondra
<tomas.vondra@enterprisedb.com> wrote:
>
> Attached is a patch, rebased on top of the sequence decoding stuff I
> pushed earlier today, also including the comments rewording, and
> renaming the "transform" function.
>
> I'll go over it again and get it pushed soon, unless someone objects.
>

You haven't addressed the comments given by me earlier this week. See
https://www.postgresql.org/message-id/CAA4eK1LY_JGL7LvdT64ujEiEAVaADuhdej1QNnwxvO_-KPzeEg%40mail.gmail.com.

*
+ * XXX The name is a bit misleading, because we don't really transform
+ * anything here - we merely check the column list is compatible with the
+ * definition of the publication (with publish_via_partition_root=false)
+ * we only allow column lists on the leaf relations. So maybe rename it?
+ */
+static void
+CheckPubRelationColumnList(List *tables, const char *queryString,
+    bool pubviaroot)

After changing this function name, the comment above is not required.

-- 
With Regards,
Amit Kapila.

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →

Doc: Explain about Column List feature.
- f98d07424523 16.0 landed
- 25996a82a446 15.0 landed
Doc: fix column list vs. replica identity rules.
- 376af686111e 16.0 landed
- ab3131880d8a 15.0 landed
Prohibit combining publications with different column lists.
- fd0b9dcebda7 15.0 cited
Fix the check to limit sync workers.
- be46985bed8a 10.21 landed
- a90de822e483 11.16 landed
- 59348fbdeb7b 12.11 landed
- 82d4a17a1750 13.7 landed
- c9dea58e2702 14.3 landed
- dd4ab6fd6528 15.0 landed
Wait for subscription to sync in t/031_column_list.sql
- 404f49338fef 15.0 landed
Move prattrs to the pg_publication_rel section in docs
- 41b00f8e601f 15.0 landed
Allow specifying column lists for logical replication
- 923def9a533a 15.0 landed
Fix row filters with multiple publications
- 5a079662256e 15.0 landed
Fix publish_as_relid with multiple publications
- 27fafee72d17 13.7 landed
- 677a1dc0ca0f 14.3 landed
- c91f71b9dc91 15.0 landed
Add some additional tests for row filters in logical replication.
- ceb57afd3ce1 15.0 cited
Add index on pg_publication_rel.prpubid
- 025b920a3d45 15.0 landed
Avoid using DefElemAction in AlterPublicationStmt
- 9623d8999603 15.0 landed
Small cleanups related to PUBLICATION framework code
- c9105dd3660f 15.0 landed
Add PublicationTable and PublicationRelInfo structs
- 0c6828fa987b 15.0 landed
Fix various concurrency issues in logical replication worker launching
- de4389712206 10.0 cited