Re: logical decoding : exceeded maxAllocatedDescs for .spill files

Amit Kapila <amit.kapila16@gmail.com>

From: Amit Kapila <amit.kapila16@gmail.com>
To: Amit Khandekar <amitdkhan.pg@gmail.com>, Noah Misch <noah@leadboat.com>
Cc: Alvaro Herrera from 2ndQuadrant <alvherre@alvh.no-ip.org>, Andres Freund <andres@anarazel.de>, Juan José Santamaría Flecha <juanjo.santamaria@gmail.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>, Robert Haas <robertmhaas@gmail.com>, Thomas Munro <thomas.munro@gmail.com>, Tom Lane <tgl@sss.pgh.pa.us>, Tomas Vondra <tomas.vondra@2ndquadrant.com>
Date: 2020-01-03T04:49:12Z
Lists: pgsql-hackers

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →
  1. When a TAP file has non-zero exit status, retain temporary directories.

  2. Fix running out of file descriptors for spill files.

  3. Track statistics for spilling of changes from ReorderBuffer.

  4. Handle ReadFile() EOF correctly on Windows.

  5. Add logical_decoding_work_mem to limit ReorderBuffer memory usage.

  6. Generational memory allocator

  7. Support retaining data dirs on successful TAP tests

On Fri, Jan 3, 2020 at 8:29 AM Amit Kapila <amit.kapila16@gmail.com> wrote:

> On Thu, Jan 2, 2020 at 5:44 PM Amit Kapila <amit.kapila16@gmail.com>
> wrote:
>
>> On Tue, Dec 24, 2019 at 2:31 PM Amit Khandekar <amitdkhan.pg@gmail.com>
>> wrote:
>> >
>> >
>> > Ok. I tested pg94_95_use_vfd_for_logrep.patch for 9.6 branch, and it
>> > works there. So please use this patch for all the three branches.
>> >
>>
>> Pushed!
>>
>
>
> I see one failure in REL_10_STABLE [1] which seems to be due to this
> commit:
>
>
I tried this test on my CentOs and Power8 machine more than 50 times, but
couldn't reproduce it.  So, adding Noah to see if he can try this test [1]
on his machine (tern) and get stack track or some other information?

[1] - make -C src/test/recovery/ check PROVE_TESTS=t/006_logical_decoding.pl

-- 
With Regards,
Amit Kapila.
EnterpriseDB: http://www.enterprisedb.com