Re: stress test for parallel workers
Tom Lane <tgl@sss.pgh.pa.us>
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Thomas Munro <thomas.munro@gmail.com>
Cc: Andrew Dunstan <andrew.dunstan@2ndquadrant.com>,
Mark Wong <mark@2ndquadrant.com>,
Justin Pryzby <pryzby@telsasoft.com>,
Andres Freund <andres@anarazel.de>,
pgsql-hackers <pgsql-hackers@postgresql.org>
Date: 2019-10-11T21:13:04Z
Lists: pgsql-hackers
I wrote: > It's not very clear how those things would lead to an intermittent > failure though. In the case of the postmaster crashes, we now see > that timing of signal receipts is relevant. For infinite_recurse, > maybe it only fails if an sinval interrupt happens at the wrong time? > (This theory would predict that commit 798070ec0 made the problem > way more prevalent than it had been ... need to go see if the > buildfarm history supports that.) That seems to fit, roughly: commit 798070ec0 moved errors.sql to execute as part of a parallel group on 2019-04-11, and the first failure of the infinite_recurse test happened on 2019-04-27. Since then we've averaged about one such failure every four days, which makes a sixteen-day gap a little more than you'd expect, but not a huge amount more. Anyway, I do not see any other commits in between that would plausibly have affected this. In other news, I reproduced the problem with gcc on wobbegong's host, and confirmed that the gcc build uses less stack space: one recursive cycle of reaper() and sigusr1_handler() consumes 14768 bytes with clang, but just 9296 bytes with gcc. So the evident difference in failure rate between wobbegong and vulpes is nicely explained by that. Still no theory about pg_upgrade versus vanilla "make check" though. I did manage to make it happen during "make check" by dint of reducing the "ulimit -s" setting, so it's *possible* for it to happen there, it just doesn't. Weird. regards, tom lane
Commits
-
In the postmaster, rely on the signal infrastructure to block signals.
- 8b53dbada4a6 12.5 landed
- 85834023a95e 11.10 landed
- 7753ca49d358 9.6.20 landed
- 4e95733b0864 10.15 landed
- 9abb2bfc0460 13.0 landed
-
Paper over regression failures in infinite_recurse() on PPC64 Linux.
- c7e2364a5f17 12.5 landed
- ae0f7b11f143 14.0 landed
- 855b6f287100 13.1 landed
-
Hack pg_ctl to report postmaster's exit status.
- 6a5084eed495 13.0 landed
-
Re-order some regression test scripts for more parallelism.
- 798070ec058f 12.0 cited