Re: Parallel scan with SubTransGetTopmostTransaction assert coredump
Pavel Borisov <pashkin.elfe@gmail.com>
From: Pavel Borisov <pashkin.elfe@gmail.com>
To: Maxim Orlov <m.orlov@postgrespro.ru>
Cc: Tomas Vondra <tomas.vondra@enterprisedb.com>,
Greg Nancarrow <gregn4422@gmail.com>, Robert Haas <robertmhaas@gmail.com>, Michael Paquier <michael@paquier.xyz>, Pengchengliu <pengchengliu@tju.edu.cn>, Andres Freund <andres@anarazel.de>, PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2021-07-13T10:23:48Z
Lists: pgsql-hackers
> > > So yeah, I think this is due to confusion with two snapshots and > > failing > > to consider both of them when calculating TransactionXmin. > > > > But I think removing one of the snapshots (as the v2 does it) is rather > > strange too. I very much doubt having both the transaction and active > > snapshots in the parallel worker is not intentional, and Pavel may very > > well be right this breaks isolation levels that use the xact snapshot > > (i.e. REPEATABLE READ and SERIALIZABLE). I haven't checked, though. > > > > So I think we need to keep both snapshots, but fix TransactionXmin to > > consider both of them - I suppose ParallelWorkerMain could simply look > > at the two snapshots, and use the minimum. Which is what [1] (already > > linked by Pavel) talks about, although that's related to concerns about > > one of the processes dying, which is not what's happening here. > > > > > > I'm wondering what consequences this may have on production systems, > > though. We've only seen this failing because of the assert, so what > > happens when the build has asserts disabled? > Looking at SubTransGetTopmostTransaction, it seems the while loop ends > > immediately (because it's pretty much the opposite of the assert), so > > we > > just return the "xid" as topmost XID. But will that produce incorrect > > query results, or what? > I haven't seen anything incorrect on production systems with asserts turned off, by I should note this assertion is not immediately reproduced so it is not that easy to catch the possible logical inconsequences of parallel scan results. As I've noticed that subxids cache is used in most cases and even this assertion is also rare in parallel scans. Maybe that is why we lived with this bug unnoticed so long. /www.postgresql.org/message-id/20150208002027.GH9201%40alap3.anarazel.de > <https://www.postgresql.org/message-id/20150208002027.GH9201%40alap3.anarazel.de> > > PFA v4 patch based on the ideas above. > > In principle I see little difference with v3. But I agree it is more > correct. > > I did test this patch on Linux and MacOS using testing algo above and > got no error. On master branch before the patch I still see this error. > I've tested the patch and the error doesn't appear anymore. -- Best regards, Pavel Borisov Postgres Professional: http://postgrespro.com <http://www.postgrespro.com>
Commits
-
Fix broken snapshot handling in parallel workers.
- 96f6ef9fe451 10.19 landed
- 198cf81e2c64 11.14 landed
- f4b77e82ebf4 12.9 landed
- bc062cb93823 13.5 landed
- 11c1239881b3 14.0 landed
- a780b2fcce6c 15.0 landed
-
Doc: move some catalogs.sgml entries to the right place.
- 713a431c781f 14.0 cited
-
Stamp 13.2.
- 3fb4c75e857a 13.2 cited
-
Create an infrastructure for parallel computation in PostgreSQL.
- 924bcf4f16d5 9.5.0 cited