Re: Reorderbuffer crash during recovery
vignesh C <vignesh21@gmail.com>
From: vignesh C <vignesh21@gmail.com>
To: Andres Freund <andres@anarazel.de>
Cc: Amit Kapila <amit.kapila16@gmail.com>,
Tomas Vondra <tomas.vondra@2ndquadrant.com>, Dilip Kumar <dilipbalaut@gmail.com>, PostgreSQL mailing lists <pgsql-bugs@lists.postgresql.org>, PostgreSQL Hackers <pgsql-hackers@postgresql.org>
Date: 2019-11-08T04:34:56Z
Lists: pgsql-bugs, pgsql-hackers
On Thu, Nov 7, 2019 at 10:01 PM Andres Freund <andres@anarazel.de> wrote: > > Hi, > > On 2019-11-07 17:03:44 +0530, Amit Kapila wrote: > > On Thu, Nov 7, 2019 at 4:48 PM Tomas Vondra > > <tomas.vondra@2ndquadrant.com> wrote: > > > > > > I'm a bit confused - does this happen only with the logical_work_mem > > > patches, or with clean master too? > > > > > > > This occurs with the clean master. This is a base code problem > > revealed while doing stress testing of logical_work_mem patches. > > As far as I can tell there are no repro steps included? Any chance to > get those? > This problem does not occur consistently. When I was reviewing and testing "logical streaming for large in-progress transactions" link [1] I found the crashes. This issue does not occur directly, meaning this issue will occur only when some crash occurs in postgres process(not from reorderbuffer but due to some other issue), after the original non-reorderbuffer crash this reorderbuffer crash appears. To simplify the reorderbuffer crash, I used the following steps: 1) Make replication setup with publisher/subscriber for some table 2) Prepare a sql file with the below: begin; 4096 insert statements; select pg_sleep(120) 3) Execute the above script. 4) Attach the postgres process when pg_sleep is in progress. 5) call abort() from attached gdb. 6) After sometime there will be many core files in publisher installation data directory. [1] https://commitfest.postgresql.org/25/1927/ Regards, Vignesh EnterpriseDB: http://www.enterprisedb.com On Thu, Nov 7, 2019 at 10:01 PM Andres Freund <andres@anarazel.de> wrote: > Hi, > > On 2019-11-07 17:03:44 +0530, Amit Kapila wrote: > > On Thu, Nov 7, 2019 at 4:48 PM Tomas Vondra > > <tomas.vondra@2ndquadrant.com> wrote: > > > > > > I'm a bit confused - does this happen only with the logical_work_mem > > > patches, or with clean master too? > > > > > > > This occurs with the clean master. This is a base code problem > > revealed while doing stress testing of logical_work_mem patches. > > As far as I can tell there are no repro steps included? Any chance to > get those? > > Greetings, > > Andres Freund >
Commits
-
Set ReorderBufferTXN->final_lsn more eagerly
- fe955ebee0f2 11.7 landed
- e3154aae3c26 10.12 landed
- cdb14154bb00 9.6.17 landed
- bc2140627ff1 12.2 landed
- 58997ace5b37 9.5.21 landed
- 20a1dc1e311d 9.4.26 landed
- 15cac3a523cc 13.0 landed
-
Fix failure to delete spill files of aborted transactions
- df9f682c7bf8 11.0 cited