Re: hyrax vs. RelationBuildPartitionDesc
Tom Lane <tgl@sss.pgh.pa.us>
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Andres Freund <andres@anarazel.de>
Cc: Robert Haas <robertmhaas@gmail.com>,
Alvaro Herrera <alvherre@2ndquadrant.com>,
PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2019-03-13T21:10:55Z
Lists: pgsql-hackers
Andres Freund <andres@anarazel.de> writes: > On 2019-03-13 16:50:53 -0400, Robert Haas wrote: >> On Wed, Mar 13, 2019 at 4:38 PM Robert Haas <robertmhaas@gmail.com> wrote: >>> On Wed, Mar 13, 2019 at 4:18 PM Tom Lane <tgl@sss.pgh.pa.us> wrote: >>>> Off topic for the moment, since this clearly wouldn't be back-patch >>>> material, but I'm starting to wonder if we should just have a context >>>> for each relcache entry and get rid of most or all of the retail >>>> cleanup logic in RelationDestroyRelation ... >> It just occurred to me that one advantage of this would be that you >> could see how much memory was being used by each relcache entry using >> MemoryContextStats(), which seems super-appealing. > But it might also make it frustrating to look at memory context dumps - > we'd suddenly have many many more memory context lines we'd displayed, > right? Wouldn't that often make the dump extremely long? There's already a mechanism in there to suppress child contexts after 100 or so, which would almost inevitably kick in on the relcache if we did this. So I don't believe we'd have a problem with the context dumps getting too long --- more likely, the complaints would be the reverse. My gut feeling is that right now relcache entries tend to be mas-o-menos the same size, except for stuff that is *already* in sub-contexts, like index and partition descriptors. So I'm not that excited about this adding useful info to context dumps. I was just looking at it as a way to make relcache entry cleanup simpler and less leak-prone. Having said that, I do agree that CacheMemoryContext is too much of an undifferentiated blob right now, and splitting it up seems like it'd be good for accountability. I'd definitely be +1 for a catcache vs. relcache vs. other caches split. You could imagine per-catcache contexts, too. The main limiting factor here is that the per-context overhead could get excessive. regards, tom lane
Commits
-
Load relcache entries' partitioning data on-demand, not immediately.
- 5b9312378e2f 13.0 landed
-
Prevent memory leaks associated with relcache rd_partcheck structures.
- d4c50b4b1f86 10.8 landed
- 5f1433ac5e7f 12.0 landed
- 089e4d405d0f 11.3 landed
-
Don't copy PartitionBoundInfo in set_relation_partition_info.
- c8151e642368 12.0 landed
-
Further reduce memory footprint of CLOBBER_CACHE_ALWAYS testing.
- d3f48dfae42f 12.0 landed
-
Fix some oversights in commit 2455ab488.
- de570047993b 12.0 landed
-
Defend against leaks into RelationBuildPartitionDesc.
- 2455ab48844c 12.0 landed
-
Allow ATTACH PARTITION with only ShareUpdateExclusiveLock.
- 898e5e3290a7 12.0 cited