Re: [Patch] Optimize dropping of relation buffers using dlist
Kyotaro Horiguchi <horikyota.ntt@gmail.com>
From: Kyotaro Horiguchi <horikyota.ntt@gmail.com>
To: amit.kapila16@gmail.com
Cc: k.jamison@fujitsu.com, tsunakawa.takay@fujitsu.com, andres@anarazel.de,
tgl@sss.pgh.pa.us, thomas.munro@gmail.com, robertmhaas@gmail.com,
tomas.vondra@2ndquadrant.com, pgsql-hackers@postgresql.org
Date: 2020-12-08T01:54:38Z
Lists: pgsql-hackers
I'm out of it more than usual.. At Tue, 08 Dec 2020 09:45:53 +0900 (JST), Kyotaro Horiguchi <horikyota.ntt@gmail.com> wrote in > At Mon, 7 Dec 2020 17:18:31 +0530, Amit Kapila <amit.kapila16@gmail.com> wrote in > > On Mon, Dec 7, 2020 at 12:32 PM k.jamison@fujitsu.com > > <k.jamison@fujitsu.com> wrote: > > > > > > On Friday, December 4, 2020 8:27 PM, Amit Kapila <amit.kapila16@gmail.com> wrote: > > > Hi, > > > I have reported before that it is not always the case that the "cached" flag of > > > srnblocks() return true. So when I checked the truncate test case used in my > > > patch, it does not enter the optimization path despite doing INSERT before > > > truncation of table. > > > The reason for that is because in TRUNCATE, a new RelFileNode is assigned > > > to the relation when creating a new file. In recovery, XLogReadBufferExtended() > > > always opens the RelFileNode and calls smgrnblocks() for that RelFileNode for the > > > first time. And for recovery processing, different RelFileNodes are used for the > > > INSERTs to the table and TRUNCATE to the same table. > > > > > > > Hmm, how is it possible if Insert is done before Truncate? The insert > > should happen in old RelFileNode only. I have verified by adding a > > break-in (while (1), so that it stops there) heap_xlog_insert and > > DropRelFileNodesAllBuffers(), and both get the same (old) RelFileNode. > > How have you verified what you are saying? It's irrelvant that the insert happens on the old relfilenode. We drop buffers for the old relfilenode on truncation anyway. What I did is: a: Create a physical replication pair. b: On the master, create a table. (without explicitly starting a tx) c: On the master, insert a tuple into the table. d: On the master truncate the table. On the standby, smgrnblocks is called for the old relfilenode of the table at c, then the same function is called for the same relfilenode at d and the function takes the cached path. regards. -- Kyotaro Horiguchi NTT Open Source Software Center
Commits
-
Fix size overflow in calculation introduced by commits d6ad34f3 and bea449c6.
- 519e4c9ee21a 14.0 landed
-
Optimize DropRelFileNodesAllBuffers() for recovery.
- bea449c635c0 14.0 landed
-
Optimize DropRelFileNodeBuffers() for recovery.
- d6ad34f3410f 14.0 landed
-
Cache smgrnblocks() results in recovery.
- c5315f4f4484 14.0 cited
-
Add a check to prevent overwriting valid data if smgrnblocks() gives a
- ffae5cc5a602 8.2.0 cited