Re: Reducing memory consumed by RestrictInfo list translations in partitionwise join planning

Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>

From: Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
To: Amit Langote <amitlangote09@gmail.com>
Cc: David Rowley <dgrowleyml@gmail.com>, Alvaro Herrera <alvherre@alvh.no-ip.org>, Dmitry Dolgov <9erthalion6@gmail.com>, tomas@vondra.me, vignesh C <vignesh21@gmail.com>, pgsql-hackers <pgsql-hackers@postgresql.org>, Richard Guo <guofenglinux@gmail.com>
Date: 2025-04-04T08:47:50Z
Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →
  1. Add assertion to verify derived clause has constant RHS

  2. Make derived clause lookup in EquivalenceClass more efficient

  3. Doc: improve documentation for jsonpath behavior.

  4. Work around implementation restriction in adjust_appendrel_attrs.

On Fri, Apr 4, 2025 at 2:04 PM Amit Langote <amitlangote09@gmail.com> wrote:
>
> On Thu, Apr 3, 2025 at 12:28 PM Amit Langote <amitlangote09@gmail.com> wrote:
> > On Wed, Apr 2, 2025 at 9:52 PM Ashutosh Bapat
> > <ashutosh.bapat.oss@gmail.com> wrote:
> > > On Wed, Apr 2, 2025 at 1:00 PM Amit Langote <amitlangote09@gmail.com> wrote:
> > > > I'm feeling good about this version, but let me know if you have any
> > > > further thoughts / comments.
> > >
> > > Thanks for incorporating the changes and fixing initial hash table size.
> > >
> > > + #define EC_DERIVES_HASH_THRESHOLD 32
> > >
> > > Given that the constant is being used only at a single place, we don't
> > > need a macro. But I am not against the macro.
> >
> > Yeah, let's keep it, because it documents well.
> >
> > > PFA patch set with some minor edits in 0003. Also I have edited commit
> > > message of 0001 and 0002.
> > >
> > > In the commit messages of 0002,
> > > 1. mentioning that the lookup happens only for join clause generation
> > > is not accurate, since we lookup EM = constant clauses as well which
> > > are not join clauses.
> > > 2. In the second paragraph em1 and em2 are mentioned without
> > > mentioning what are they. I have rephrased it so as to avoid
> > > mentioning names of structure member.
> >
> > Incorporated, thanks.
> >
> > I'll plan to commit these tomorrow barring objections.
>
> I’ve now marked this as committed after pushing the patches earlier today.

Thanks a lot.

>
> I realize the CF entry was originally about the project to reduce
> memory usage during partitionwise join planning, but we ended up
> committing something else. I suppose we can create a new entry if and
> when we pick that original work back up.

Will create a new CF entry just to keep the patch floated.

-- 
Best Wishes,
Ashutosh Bapat