Re: tableam vs. TOAST
Andres Freund <andres@anarazel.de>
From: Andres Freund <andres@anarazel.de>
To: Robert Haas <robertmhaas@gmail.com>
Cc: Peter Eisentraut <peter.eisentraut@2ndquadrant.com>, Alvaro Herrera <alvherre@2ndquadrant.com>, Prabhat Sahu <prabhat.sahu@enterprisedb.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2019-11-06T17:00:18Z
Lists: pgsql-hackers
Hi, On 2019-11-06 11:49:10 -0500, Robert Haas wrote: > On Wed, Nov 6, 2019 at 11:25 AM Andres Freund <andres@anarazel.de> wrote: > > I think it's more than just that. It's also that I think presenting a > > hardcoded value to the outside of / above an AM is architecturally > > wrong. If anything this is an implementation detail of the AM, that the > > AM ought to be concerned with internally, not something it should > > present to the outside. > > I mean, it depends on your vision of how things ought to be > abstracted. If you want the TOAST stuff to be logically "below" the > table AM layer, then this is an abstraction violation. But if you > think of TOAST as being a parallel system to table AM, then it's fine. > It also depends on your goals. If you want to give the table AM > maximum freedom to do what it likes, the design I proposed is not very > good. If you want to make it easy for someone to plug in a new AM that > does toasting like the current heap but with a different chunk size, > that design lets you do so with a very minimal amount of code. I'd like an AM to have the *option* of implementing something better, or at least go in the direction of making that possible. It seems perfectly possible to have a helper function implementing the current logic that you just can call with the fixed chunk size as an additional parameter. Which'd basically mean there's no meaningful difference in complexity compared to providing the chunk size as an external AM property. In one case you have a callback that just calls a helper function with one parameter, in the other you fill in a member of the struct. Greetings, Andres Freund
Commits
-
tableam: New callback relation_fetch_toast_slice.
- ce242ae154dd 13.0 landed
-
tableam: Allow choice of toast AM.
- 83322e38da1a 13.0 landed
-
Move heap-specific detoasting logic into a separate function.
- e9fd0415e6e2 13.0 landed
-
Code cleanup for toast_fetch_datum and toast_fetch_datum_slice.
- d5406dea25b6 13.0 landed
-
Rename some toasting functions based on whether they are heap-specific.
- 2e8b6bfa90b2 13.0 landed
-
Create an API for inserting and deleting rows in TOAST tables.
- bd124996ef0d 13.0 landed
-
Split tuptoaster.c into three separate files.
- 8b94dab06617 13.0 landed
-
tableam: Move heap-specific logic from needs_toast_table below tableam.
- 1171d7d58545 12.0 cited