Re: Berserk Autovacuum (let's save next Mandrill)
Michael Banck <mbanck@gmx.net>
From: Michael Banck <mbanck@gmx.net>
To: David Rowley <david.rowley@2ndquadrant.com>
Cc: Alvaro Herrera <alvherre@2ndquadrant.com>, Darafei Komяpa Praliaskouski <me@komzpa.net>, PostgreSQL Developers <pgsql-hackers@lists.postgresql.org>
Date: 2019-03-29T09:06:06Z
Lists: pgsql-hackers
Hi, On Thu, Mar 28, 2019 at 12:36:24PM +1300, David Rowley wrote: > On Thu, 28 Mar 2019 at 11:01, Alvaro Herrera <alvherre@2ndquadrant.com> wrote: > > I wonder if Mandrill's problem is related to Mailchimp raising the > > freeze_max_age to a point where autovac did not have enough time to > > react with an emergency vacuum. If you keep raising that value because > > the vacuums cause problems for you (they block DDL), there's something > > wrong. > > I have seen some very high autovacuum_freeze_max_age settings > recently. It would be interesting to know what they had theirs set to. > I see they mentioned "Search and Url tables". I can imagine "search" > never needs any UPDATEs, so quite possibly those were append-only, in > which case the anti-wraparound vacuum would have had quite a lot of > work on its hands since possibly every page needed frozen. A table > receiving regular auto-vacuums from dead tuples would likely get some > pages frozen during those. By the way, the Routine Vacuuming chapter of the documentation says: "The sole disadvantage of increasing autovacuum_freeze_max_age (and vacuum_freeze_table_age along with it) is that the pg_xact and pg_commit_ts subdirectories of the database cluster will take more space [...] If [pg_xact and pg_commit_ts taking 0.5 and 20 GB, respectively] is trivial compared to your total database size, setting autovacuum_freeze_max_age to its maximum allowed value is recommended." Maybe this should be qualified with "unless you have trouble with your autovacuum keeping up" or so; or generally reworded? Michael
Commits
-
Further improve stability fix for partition_aggregate test.
- 18d85e9b8a2b 13.0 landed
-
Improve stability fix for partition_aggregate test.
- 7cb0a423f914 13.0 landed
-
Attempt to stabilize partitionwise_aggregate test
- cefb82d49e21 13.0 landed
-
Fix race condition in statext_store().
- fe3036527a1f 13.0 landed
- 6c426cd43790 12.3 landed
-
Attempt to fix unstable regression tests, take 2
- 24566b359d09 13.0 landed
-
Attempt to fix unstable regression tests
- 2dc16efedc76 13.0 landed
-
Trigger autovacuum based on number of INSERTs
- b07642dbcd8d 13.0 landed
-
Fix upper limit for vacuum_cleanup_index_scale_factor
- 4d54543efa5e 11.0 cited