Re: Berserk Autovacuum (let's save next Mandrill)
David Rowley <dgrowleyml@gmail.com>
From: David Rowley <dgrowleyml@gmail.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Laurenz Albe <laurenz.albe@cybertec.at>, Andres Freund <andres@anarazel.de>, Alexander Korotkov <a.korotkov@postgrespro.ru>, Justin Pryzby <pryzby@telsasoft.com>, Alvaro Herrera <alvherre@2ndquadrant.com>, Masahiko Sawada <masahiko.sawada@2ndquadrant.com>, Tomas Vondra <tomas.vondra@2ndquadrant.com>, Amit Kapila <amit.kapila16@gmail.com>, Masahiko Sawada <sawada.mshk@gmail.com>, Darafei Komяpa Praliaskouski <me@komzpa.net>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2020-03-29T02:29:51Z
Lists: pgsql-hackers
Attachments
- temp_telemetry_checks_for_unstable_tests.patch (application/octet-stream) patch
On Sun, 29 Mar 2020 at 10:30, David Rowley <dgrowleyml@gmail.com> wrote: > > On Sun, 29 Mar 2020 at 06:26, Tom Lane <tgl@sss.pgh.pa.us> wrote: > > > > David Rowley <dgrowleyml@gmail.com> writes: > > > On Sat, 28 Mar 2020 at 17:12, Laurenz Albe <laurenz.albe@cybertec.at> wrote: > > >> In the light of that, I have no objections. > > > > > Thank you. Pushed. > > > > It seems like this commit has resulted in some buildfarm instability: > > > > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=lousyjack&dt=2020-03-28%2006%3A33%3A02 > > > > apparent change of plan > > > > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=petalura&dt=2020-03-28%2009%3A20%3A05 > > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=petalura&dt=2020-03-28%2013%3A20%3A05 > > > > unstable results in stats_ext test > > Yeah, thanks for pointing that out. I'm just doing some tests locally > to see if I can recreate those results after vacuuming the mcv_list > table, so far I'm unable to. I'm considering pushing the attached to try to get some confirmation that additional autovacuums are the issue. However, I'm not too sure it's a wise idea to as I can trigger an additional auto-vacuum and have these new tests fail with make installcheck after setting autovacuum_naptime to 1s, but I'm not getting the other diffs experienced by lousyjack and petalura. The patch may just cause more failures without proving much, especially so with slower machines. The other idea I had was just to change the autovacuum_vacuum_insert_threshold relopt to -1 for the problem tables and see if that stabilises things. Yet another option would be to see if reltuples varies between runs and ditch the autovacuum_count column from the attached. There does not appear to be any part of the tests which would cause any dead tuples in any of the affected relations, so I'm unsure why reltuples would vary between what ANALYZE and VACUUM would set it to. I'm still thinking. Input welcome. David
Commits
-
Further improve stability fix for partition_aggregate test.
- 18d85e9b8a2b 13.0 landed
-
Improve stability fix for partition_aggregate test.
- 7cb0a423f914 13.0 landed
-
Attempt to stabilize partitionwise_aggregate test
- cefb82d49e21 13.0 landed
-
Fix race condition in statext_store().
- fe3036527a1f 13.0 landed
- 6c426cd43790 12.3 landed
-
Attempt to fix unstable regression tests, take 2
- 24566b359d09 13.0 landed
-
Attempt to fix unstable regression tests
- 2dc16efedc76 13.0 landed
-
Trigger autovacuum based on number of INSERTs
- b07642dbcd8d 13.0 landed
-
Fix upper limit for vacuum_cleanup_index_scale_factor
- 4d54543efa5e 11.0 cited