Re: Using Valgrind to detect faulty buffer accesses (no pin or buffer content lock held)
Peter Geoghegan <pg@bowt.ie>
From: Peter Geoghegan <pg@bowt.ie>
To: Anastasia Lubennikova <a.lubennikova@postgrespro.ru>
Cc: Daniel Gustafsson <daniel@yesql.se>, Andres Freund <andres@anarazel.de>, Alvaro Herrera <alvherre@2ndquadrant.com>, Masahiko Sawada <masahiko.sawada@2ndquadrant.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2020-07-18T00:53:00Z
Lists: pgsql-hackers
On Thu, Jul 16, 2020 at 10:24 AM Anastasia Lubennikova <a.lubennikova@postgrespro.ru> wrote: > It's impressive that this check helped to find several bugs. While it's definitely true that it *could* have detected the bug fixed by commit b0229f26, it's kind of debatable whether or not the bugs I fixed in commit fa7ff642 and commit 7154aa16 (which actually were found using this new instrumentation) were truly bugs. The behavior in question was probably safe, since only the special/opaque page area was accessed -- and with at least a buffer pin held. But it's not worth having a debate about whether or not it should be considered safe. There is no downside to not having a simple strict rule that's easy to enforce. Also, I myself spotted some bugs in the skip scan patch series at one point that would also be caught by the new instrumentation. > I only noticed small inconsistency in the new comment for > _bt_conditionallockbuf(). > > It says "Note: Caller is responsible for calling _bt_checkpage() on > success.", while in _bt_getbuf() the call is not followed by > _bt_checkpage(). > Moreover, _bt_page_recyclable() contradicts _bt_checkpage() checks. Nice catch. > Other than that, patches look good to me, so move them to "Ready For > Committer". Pushed the first patch just now, and intend to push the other one soon. Thanks! > Are you planning to add same checks for other access methods? Not at the moment, but it does seem like my approach could be generalized to other index access methods. -- Peter Geoghegan
Commits
-
Add nbtree Valgrind buffer lock checks.
- 4a70f829d86c 14.0 landed
-
Add Valgrind buffer access instrumentation.
- 1e0dfd166b3f 14.0 landed
-
Fix bug in nbtree VACUUM "skip full scan" feature.
- b0229f26da75 13.0 cited
-
Fix another minor page deletion buffer lock issue.
- 7154aa16a64d 13.0 landed
-
Fix minor nbtree page deletion buffer lock issue.
- fa7ff642c22c 13.0 landed
-
Skip full index scan during cleanup of B-tree indexes when possible
- 857f9c36cda5 11.0 cited