Re: Reference to - BUG #18349: ERROR: invalid DSA memory alloc request size 1811939328, CONTEXT: parallel worker
Craig Milhiser <craig@milhiser.com>
From: Craig Milhiser <craig@milhiser.com>
To: Thomas Munro <thomas.munro@gmail.com>
Cc: Tom Lane <tgl@sss.pgh.pa.us>, pgsql-bugs@lists.postgresql.org
Date: 2024-09-29T23:03:12Z
Lists: pgsql-bugs
> Having said that, Aurora is not Postgres, and I don't know > how closely they track us. Can you reproduce this problem > on a stock build of community Postgres? I reproduced the issue on v17. I downloaded the source tarball, built it, passed tests, put my production database, analyzed and ran the query. As you expected, the same issue occurred. I have opened the incident with the AWS team as well. select version(); version -------------------------------------------------------------------------------------------------- PostgreSQL 17.0 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 13.2.0-23ubuntu4) 13.2.0, 64-bit Since I have this saved for building, if you need logs or have an experiment, let me know. I tried to reproduce the issue with artificial data simply but the query completed. A different optimization plan was created since the data skew was very different. I have workarounds of turning parallel execution off for the known queries and when possible rewriting the queries. Thanks for the help. Craig
Commits
-
Fix extreme skew detection in Parallel Hash Join.
- 98c7c7152d2d 18.0 landed
- 4ac5d33a8b08 17.1 landed
- 53edc948580f 16.5 landed
- 1831545ca186 15.9 landed
- 20d94899414a 14.14 landed
- 45329466fdc9 13.17 landed
- 4fa80a6d7d4b 12.21 landed