RE: [Patch] Optimize dropping of relation buffers using dlist
k.jamison@fujitsu.com <k.jamison@fujitsu.com>
From: "k.jamison@fujitsu.com" <k.jamison@fujitsu.com>
To: "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Cc: 'Kyotaro Horiguchi' <horikyota.ntt@gmail.com>, "amit.kapila16@gmail.com" <amit.kapila16@gmail.com>, "tgl@sss.pgh.pa.us" <tgl@sss.pgh.pa.us>, "andres@anarazel.de" <andres@anarazel.de>, "robertmhaas@gmail.com" <robertmhaas@gmail.com>, "tomas.vondra@2ndquadrant.com" <tomas.vondra@2ndquadrant.com>, "pgsql-hackers@postgresql.org" <pgsql-hackers@postgresql.org>
Date: 2020-09-25T09:25:49Z
Lists: pgsql-hackers
On Friday, September 25, 2020 6:02 PM, Tsunakawa-san wrote: > From: Jamison, Kirk/ジャミソン カーク <k.jamison@fujitsu.com> > > [Results] > > Recovery/Failover performance (in seconds). 3 trial runs. > > > > | shared_buffers | master | patch | %reg | > > |----------------|--------|--------|---------| > > | 128MB | 32.406 | 33.785 | 4.08% | > > | 1GB | 36.188 | 32.747 | -10.51% | > > | 2GB | 41.996 | 32.88 | -27.73% | > > Thanks for sharing good results. We want to know if we can get as > significant results as you gained before with hundreds of GBs of shared > buffers, don't we? Yes. But I don't have a high-spec machine I could use at the moment. I'll try if I can get one by next week. Or if someone would like to reproduce the test with their available higher spec machines, it'd would be much appreciated. The test case is upthread [1] > > I also did similar benchmark performance as what Tomas did [1], simple > > "pgbench -S" tests (warmup and then 15 x 1-minute runs with 1, 8 and > > 16 clients, but I'm not sure if my machine is reliable enough to > > produce reliable results for 8 clients and more. > > Let me confirm just in case. Your patch should not affect pgbench > performance, but you measured it. Is there anything you're concerned > about? > Not really. Because In the previous emails, the argument was the BufferAlloc overhead. But we don't have it in the latest patch. But just in case somebody asks about benchmark performance, I also posted the results. [1] https://www.postgresql.org/message-id/OSBPR01MB2341683DEDE0E7A8D045036FEF360%40OSBPR01MB2341.jpnprd01.prod.outlook.com Regards, Kirk Jamison
Commits
-
Fix size overflow in calculation introduced by commits d6ad34f3 and bea449c6.
- 519e4c9ee21a 14.0 landed
-
Optimize DropRelFileNodesAllBuffers() for recovery.
- bea449c635c0 14.0 landed
-
Optimize DropRelFileNodeBuffers() for recovery.
- d6ad34f3410f 14.0 landed
-
Cache smgrnblocks() results in recovery.
- c5315f4f4484 14.0 cited
-
Add a check to prevent overwriting valid data if smgrnblocks() gives a
- ffae5cc5a602 8.2.0 cited