Re: Minimal logical decoding on standbys
Bertrand Drouvot <bertranddrouvot.pg@gmail.com>
Commits
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Reduce the log level in 035_standby_logical_decoding.pl.
- 3034dc56ef4b 16.0 landed
-
035_standby_logical_decoding: Add missing waits for replication
- 57411c82ce86 16.0 landed
-
For cascading replication, wake physical and logical walsenders separately
- e101dfac3a53 16.0 landed
-
Handle logical slot conflicts on standby
- 26669757b6a7 16.0 landed
-
Support invalidating replication slots due to horizon and wal_level
- be87200efd93 16.0 landed
-
Prevent use of invalidated logical slot in CreateDecodingContext()
- 4397abd0a2af 16.0 landed
-
Replace replication slot's invalidated_at LSN with an enum
- 15f8203a5975 16.0 landed
-
Pass down table relation into more index relation functions
- 61b313e47eb9 16.0 landed
-
Assert only valid flag bits are passed to visibilitymap_set()
- a88a18b1250b 16.0 landed
-
Remove unused _bt_delitems_delete() argument.
- dc43492e46c7 14.0 cited
-
Add xl_btree_delete optimization.
- d2e5e20e5711 13.0 cited
Hi, On 12/14/22 4:55 PM, Robert Haas wrote: > On Wed, Dec 14, 2022 at 8:06 AM Drouvot, Bertrand> > Other comments: > > + if RelationIsAccessibleInLogicalDecoding(rel) > + xlrec.flags |= VISIBILITYMAP_ON_CATALOG_ACCESSIBLE_IN_LOGICAL_DECODING; > > This is a few parentheses short of where it should be. Hilariously it > still compiles because there are parentheses in the macro definition. Oops, thanks will fix. > > + xlrec.onCatalogAccessibleInLogicalDecoding = > RelationIsAccessibleInLogicalDecoding(relation); > > These lines are quite long. I think we should consider (1) picking a > shorter name for the xlrec field and, if it's such lines are going to > still routinely exceed 80 characters, (2) splitting them into two > lines, with the second one indented to match pgindent's preferences in > such cases, which I think is something like this: > > xlrec.onCatalogAccessibleInLogicalDecoding = > RelationIsAccessibleInLogicalDecoding(relation); > > As far as renaming, I think we could at least remove onCatalog part > from the identifier, as that doesn't seem to be adding much. And maybe > we could even think of changing it to something like > logicalDecodingConflict or even decodingConflict, which would shave > off a bunch more characters. I'm not sure I like the decodingConflict proposal. Indeed, it might be there is no conflict (depending of the xids comparison). What about "checkForConflict"? > > + if (heapRelation->rd_options) > + isusercatalog = ((StdRdOptions *) > (heapRelation)->rd_options)->user_catalog_table; > > Couldn't you get rid of the if statement here and also the > initialization at the top of the function and just write isusercatalog > = RelationIsUsedAsCatalogTable(heapRelation)? Or even just get rid of > the variable entirely and pass > RelationIsUsedAsCatalogTable(heapRelation) as the argument to > UpdateIndexRelation directly? > Yeah, that's better, will do, thanks! While at it, I'm not sure that isusercatalog should be visible in pg_index. I mean, this information could be retrieved with a join on pg_class (on the table the index is linked to), so the weirdness to have it visible. I did not check how difficult it would be to make it "invisible" though. What do you think? > I think this could use some test cases demonstrating that > indisusercatalog gets set correctly in all the relevant cases: table > is created with user_catalog_table = true/false, reloption is changed, > reloptions are reset, new index is added later, etc. > v31 already provides a few checks: - After index creation on relation with user_catalog_table = true - Propagation is done correctly after a user_catalog_table RESET - Propagation is done correctly after an ALTER SET user_catalog_table = true - Propagation is done correctly after an ALTER SET user_catalog_table = false In v32, I can add a check for index creation after each of the last 3 mentioned above and one when a table is created with user_catalog_table = false. Having said that, we would need a function to retrieve the isusercatalog value should we make it invisible. Regards, -- Bertrand Drouvot PostgreSQL Contributors Team RDS Open Source Databases Amazon Web Services: https://aws.amazon.com