Re: Hybrid Hash/Nested Loop joins and caching results from subplans
Andres Freund <andres@anarazel.de>
From: Andres Freund <andres@anarazel.de>
To: David Rowley <dgrowleyml@gmail.com>
Cc: PostgreSQL Developers <pgsql-hackers@lists.postgresql.org>
Date: 2020-08-11T00:21:34Z
Lists: pgsql-hackers
Hi, On 2020-07-09 10:25:14 +1200, David Rowley wrote: > On Thu, 9 Jul 2020 at 04:53, Andres Freund <andres@anarazel.de> wrote: > > > > On 2020-05-20 23:44:27 +1200, David Rowley wrote: > > > I've attached a patch which implements this. The new node type is > > > called "Result Cache". I'm not particularly wedded to keeping that > > > name, but if I change it, I only want to do it once. I've got a few > > > other names I mind, but I don't feel strongly or confident enough in > > > them to go and do the renaming. > > > > I'm not convinced it's a good idea to introduce a separate executor node > > for this. There's a fair bit of overhead in them, and they will only be > > below certain types of nodes afaict. It seems like it'd be better to > > pull the required calls into the nodes that do parametrized scans of > > subsidiary nodes. Have you considered that? > > I see 41 different node types mentioned in ExecReScan(). I don't > really think it would be reasonable to change all those. But that's because we dispatch ExecReScan mechanically down to every single executor node. That doesn't determine how many nodes would need to modify to include explicit caching? What am I missing? Wouldn't we need roughly just nodeNestloop.c and nodeSubplan.c integration? Greetings, Andres Freund
Commits
-
Add Result Cache executor node (take 2)
- 9eacee2e62d8 14.0 landed
-
Add Result Cache executor node
- b6002a796dc0 14.0 landed
-
Allow estimate_num_groups() to pass back further details about the estimation
- ed934d4fa30f 14.0 landed
-
Allow users of simplehash.h to perform direct deletions
- ff53d7b159b9 14.0 landed
-
Cache if PathTarget and RestrictInfos contain volatile functions
- f58b230ed0db 14.0 landed
-
Fix pull_varnos' miscomputation of relids set for a PlaceHolderVar.
- 55dc86eca70b 14.0 cited