Re: Berserk Autovacuum (let's save next Mandrill)
Laurenz Albe <laurenz.albe@cybertec.at>
From: Laurenz Albe <laurenz.albe@cybertec.at>
To: David Rowley <dgrowleyml@gmail.com>
Cc: Andres Freund <andres@anarazel.de>, Justin Pryzby <pryzby@telsasoft.com>, Masahiko Sawada <masahiko.sawada@2ndquadrant.com>, Tomas Vondra <tomas.vondra@2ndquadrant.com>, Amit Kapila <amit.kapila16@gmail.com>, Masahiko Sawada <sawada.mshk@gmail.com>, Darafei Komяpa Praliaskouski <me@komzpa.net>, PostgreSQL Developers <pgsql-hackers@lists.postgresql.org>, Alvaro Herrera <alvherre@2ndquadrant.com>, Michael Banck <mbanck@gmx.net>
Date: 2020-03-19T19:47:40Z
Lists: pgsql-hackers
Attachments
- 0001-Autovacuum-tables-that-have-received-only-inserts.v9.patch (text/x-patch) patch v9-0001
On Thu, 2020-03-19 at 21:39 +1300, David Rowley wrote: > > According to my reckoning, that is the remaining objection to the patch > > as it is (with ordinary freezing behavior). > > > > How about a scale_factor od 0.005? That will be high enough for large > > tables, which seem to be the main concern here. > > I agree with that, however, I'd thought 0.01, just so we're still > close to having about 100 times less work to do for huge insert-only > tables when it comes to having to perform an anti-wraparound vacuum. Fine with me. > > I am still sorry to see more proactive freezing go, which would > > reduce the impact for truly insert-only tables. > > After sleeping on it, here is one last idea. > > > > Granted, freezing with vacuum_freeze_min_age = 0 poses a problem > > for those parts of the table that will receive updates or deletes. > > But what if insert-triggered vacuum operates with - say - > > one tenth of vacuum_freeze_min_age (unless explicitly overridden > > for the table)? That might still be high enough not to needlessly > > freeze too many tuples that will still be modified, but it will > > reduce the impact on insert-only tables. > > I think that might be a bit too magical and may not be what some > people want. I know that most people won't set > autovacuum_freeze_min_age to 0 for insert-only tables, but we can at > least throw something in the documents to mention it's a good idea, > however, looking over the docs I'm not too sure the best place to note > that down. I was afraid that idea would be too cute to appeal. > I've attached a small fix which I'd like to apply to your v8 patch. > With that, and pending one final look, I'd like to push this during my > Monday (New Zealand time). So if anyone strongly objects to that, > please state their case before then. Thanks! I have rolled your edits into the attached patch v9, rebased against current master. Yours, Laurenz Albe
Commits
-
Further improve stability fix for partition_aggregate test.
- 18d85e9b8a2b 13.0 landed
-
Improve stability fix for partition_aggregate test.
- 7cb0a423f914 13.0 landed
-
Attempt to stabilize partitionwise_aggregate test
- cefb82d49e21 13.0 landed
-
Fix race condition in statext_store().
- fe3036527a1f 13.0 landed
- 6c426cd43790 12.3 landed
-
Attempt to fix unstable regression tests, take 2
- 24566b359d09 13.0 landed
-
Attempt to fix unstable regression tests
- 2dc16efedc76 13.0 landed
-
Trigger autovacuum based on number of INSERTs
- b07642dbcd8d 13.0 landed
-
Fix upper limit for vacuum_cleanup_index_scale_factor
- 4d54543efa5e 11.0 cited