Re: logical decoding and replication of sequences
Tomas Vondra <tomas.vondra@enterprisedb.com>
From: Tomas Vondra <tomas.vondra@enterprisedb.com>
To: Alvaro Herrera <alvherre@alvh.no-ip.org>
Cc: Peter Eisentraut <peter.eisentraut@enterprisedb.com>,
PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>,
Petr Jelinek <petr.jelinek@enterprisedb.com>
Date: 2021-12-15T16:56:04Z
Lists: pgsql-hackers
On 12/15/21 17:42, Alvaro Herrera wrote:
> Looking at 0003,
>
> On 2021-Dec-14, Tomas Vondra wrote:
>
>> diff --git a/doc/src/sgml/ref/alter_publication.sgml b/doc/src/sgml/ref/alter_publication.sgml
>> index bb4ef5e5e22..4d166ad3f9c 100644
>> --- a/doc/src/sgml/ref/alter_publication.sgml
>> +++ b/doc/src/sgml/ref/alter_publication.sgml
>> @@ -31,7 +31,9 @@ ALTER PUBLICATION <replaceable class="parameter">name</replaceable> RENAME TO <r
>> <phrase>where <replaceable class="parameter">publication_object</replaceable> is one of:</phrase>
>>
>> TABLE [ ONLY ] <replaceable class="parameter">table_name</replaceable> [ * ] [, ... ]
>> + SEQUENCE <replaceable class="parameter">sequence_name</replaceable> [ * ] [, ... ]
>> ALL TABLES IN SCHEMA { <replaceable class="parameter">schema_name</replaceable> | CURRENT_SCHEMA } [, ... ]
>> + ALL SEQUENCE IN SCHEMA { <replaceable class="parameter">schema_name</replaceable> | CURRENT_SCHEMA } [, ... ]
>
> Note that this says ALL SEQUENCE; I think it should be ALL SEQUENCES.
>
>> diff --git a/src/backend/parser/gram.y b/src/backend/parser/gram.y
>> index 3d4dd43e47b..f037c17985b 100644
>> --- a/src/backend/parser/gram.y
>> +++ b/src/backend/parser/gram.y
>> @@ -9762,6 +9762,26 @@ PublicationObjSpec:
> ...
>> + | ALL SEQUENCE IN_P SCHEMA ColId
>> + {
>> + $$ = makeNode(PublicationObjSpec);
>> + $$->pubobjtype = PUBLICATIONOBJ_SEQUENCE_IN_SCHEMA;
>> + $$->name = $5;
>> + $$->location = @5;
>> + }
>> + | ALL SEQUENCES IN_P SCHEMA CURRENT_SCHEMA
>> + {
>> + $$ = makeNode(PublicationObjSpec);
>> + $$->pubobjtype = PUBLICATIONOBJ_SEQUENCE_IN_CUR_SCHEMA;
>> + $$->location = @5;
>> + }
>
> And here you have ALL SEQUENCE in one spot and ALL SEQUENCES in the
> other.
>
> BTW I think these enum values should use the plural too,
> PUBLICATIONOBJ_SEQUENCES_IN_CUR_SCHEMA (not SEQUENCE). I suppose you
> copied from PUBLICATIONOBJ_TABLE_IN_CUR_SCHEMA, but that too seems to be
> a mistake: should be PUBLICATIONOBJ_TABLES_IN_CUR_SCHEMA.
>
>
>> @@ -10097,6 +10117,12 @@ UnlistenStmt:
>> }
>> ;
>>
>> +/*
>> + * FIXME
>> + *
>> + * opt_publication_for_sequences and publication_for_sequences should be
>> + * copies for sequences
>> + */
>
> Not sure if this FIXME is relevant or should just be removed.
>
>> @@ -10105,6 +10131,12 @@ UnlistenStmt:
>> * BEGIN / COMMIT / ROLLBACK
>> * (also older versions END / ABORT)
>> *
>> + * ALTER PUBLICATION name ADD SEQUENCE sequence [, sequence2]
>> + *
>> + * ALTER PUBLICATION name DROP SEQUENCE sequence [, sequence2]
>> + *
>> + * ALTER PUBLICATION name SET SEQUENCE sequence [, sequence2]
>> + *
>
> This comment addition seems misplaced?
>
>> diff --git a/src/bin/psql/tab-complete.c b/src/bin/psql/tab-complete.c
>> index 2f412ca3db3..e30bf7b1b55 100644
>> --- a/src/bin/psql/tab-complete.c
>> +++ b/src/bin/psql/tab-complete.c
>> @@ -1647,13 +1647,13 @@ psql_completion(const char *text, int start, int end)
>> COMPLETE_WITH("ADD", "DROP", "OWNER TO", "RENAME TO", "SET");
>> /* ALTER PUBLICATION <name> ADD */
>> else if (Matches("ALTER", "PUBLICATION", MatchAny, "ADD"))
>> - COMPLETE_WITH("ALL TABLES IN SCHEMA", "TABLE");
>> + COMPLETE_WITH("ALL TABLES IN SCHEMA", "TABLE|SEQUENCE");
>> /* ALTER PUBLICATION <name> DROP */
>> else if (Matches("ALTER", "PUBLICATION", MatchAny, "DROP"))
>> - COMPLETE_WITH("ALL TABLES IN SCHEMA", "TABLE");
>> + COMPLETE_WITH("ALL TABLES IN SCHEMA", "TABLE|SEQUENCE");
>> /* ALTER PUBLICATION <name> SET */
>> else if (Matches("ALTER", "PUBLICATION", MatchAny, "SET"))
>> - COMPLETE_WITH("(", "ALL TABLES IN SCHEMA", "TABLE");
>> + COMPLETE_WITH("(", "ALL TABLES IN SCHEMA", "TABLE|SEQUENCE");
>
> I think you should also add "ALL SEQUENCES IN SCHEMA" to these lists.
>
>
>> else if (Matches("ALTER", "PUBLICATION", MatchAny, "ADD|DROP|SET", "ALL", "TABLES", "IN", "SCHEMA"))
>
> ... and perhaps make this "ALL", "TABLES|SEQUENCES", "IN", "SCHEMA".
>
Thanks for the review. I'm aware 0003 is still incomplete and subject to
change - it's certainly not meant for commit yet. The current 0003 patch
is sufficient for testing the infrastructure, but we need to figure out
how to make it easier to use, what to do with implicit sequences and
similar things. Peter had some ideas in [1].
[1]
https://www.postgresql.org/message-id/359bf6d0-413d-292a-4305-e99eeafead39%40enterprisedb.com
--
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
Commits
-
Fix cache invalidation bug in recovery_prefetch.
- d0d934490020 15.0 landed
- 932b01630095 16.0 landed
-
Revert "Logical decoding of sequences"
- 2c7ea57e56ca 15.0 landed
-
Minor improvements in sequence decoding code and docs
- 05843b1aa49d 15.0 landed
-
Handle sequences in preprocess_pubobj_list
- 002c9dd97a0c 15.0 landed
-
Update tab-completion for CREATE PUBLICATION with sequences
- 2d2232933b02 15.0 landed
-
Add decoding of sequences to built-in replication
- 75b1521dae1f 15.0 landed
-
Stabilize test_decoding touching with sequences
- a180c2b34de0 15.0 landed
-
Call ReorderBufferProcessXid from sequence_decode
- d5ed9da41d96 15.0 landed
-
Add decoding of sequences to test_decoding
- 80901b32913f 15.0 landed
-
Replace Test::More plans with done_testing
- 549ec201d613 15.0 cited
-
Logical decoding of sequences
- 0da92dc530c9 15.0 landed
-
Respect permissions within logical replication.
- a2ab9c06ea15 15.0 cited