Re: pgsql: Introduce pg_shmem_allocations_numa view
Christoph Berg <myon@debian.org>
From: Christoph Berg <myon@debian.org>
To: Tomas Vondra <tomas.vondra@postgresql.org>
Cc: pgsql-hackers@lists.postgresql.org
Date: 2025-06-23T14:42:26Z
Lists: pgsql-hackers
Commits
Same data as JSON:
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Handle EPERM in pg_numa_init
- 599336c64fc9 19 (unreleased) landed
- 482e98ac4302 18.2 landed
-
Add CHECK_FOR_INTERRUPTS into pg_numa_query_pages
- 54ac4944c36f 18.0 landed
- bf1119d74a79 19 (unreleased) landed
-
Silence valgrind about pg_numa_touch_mem_if_required
- 14e52227e578 18.0 landed
- 81f287dc923f 19 (unreleased) landed
-
Limit the size of numa_move_pages requests
- 45879f48f140 18.0 landed
- 7fe2f67c7c9f 19 (unreleased) landed
-
Introduce pg_shmem_allocations_numa view
- 8cc139bec34a 18.0 cited
Attachments
Re: To Tomas Vondra > This is acting up on Debian's 32-bit architectures, namely i386, armel > and armhf: ... and x32 (x86_64 instruction set with 32-bit pointers). > SELECT COUNT(*) >= 0 AS ok FROM pg_shmem_allocations_numa; > +ERROR: invalid NUMA node id outside of allowed range [0, 0]: -14 > > -14 seems to be -EFAULT, and move_pages(2) says: > -EFAULT > This is a zero page or the memory area is not mapped by the process. I did some debugging on i386 and made it print the page numbers: SELECT COUNT(*) >= 0 AS ok FROM pg_shmem_allocations_numa; +WARNING: invalid NUMA node id outside of allowed range [0, 0]: -14 for page 35 +WARNING: invalid NUMA node id outside of allowed range [0, 0]: -14 for page 36 ... +WARNING: invalid NUMA node id outside of allowed range [0, 0]: -14 for page 32768 +WARNING: invalid NUMA node id outside of allowed range [0, 0]: -14 for page 32769 So it works for the first few pages and then the rest is EFAULT. I think the pg_numa_touch_mem_if_required() hack might not be enough to force the pages to be allocated. Changing that to a memcpy() didn't help. Is there some optimization that zero pages aren't allocated until being written to? Why do we try to force the pages to be allocated at all? This is just a monitoring function, it should not change the actual system state. Why not just skip any page where the status is <0 ? The attached patch removes that logic. Regression tests pass, but we probably have to think about whether to report these negative numbers as-is or perhaps convert them to NULL. Christoph