Extending amcheck to check toast size and compression
Mark Dilger <mark.dilger@enterprisedb.com>
From: Mark Dilger <mark.dilger@enterprisedb.com>
To: PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2021-05-04T16:20:00Z
Lists: pgsql-hackers
Attachments
- v1-0001-Adding-more-toast-pointer-checks-to-amcheck.patch (application/octet-stream) patch v1-0001
- (unnamed) (text/plain)
Hackers, During the version 14 development period, a few checks of toasted attributes were written but never committed. For the version 15 development cycle, I'd like to consider extending the checks of toasted attributes. First, no toasted attribute should ever have a rawsize larger than the 1GB varlena limit. Second, no compressed toasted attribute should have an extsize indicating that the toast expanded during toasting. Such a extsize could mean the compression code is malfunctioning, or that the extsize or rawsize fields are corrupt. Third, any compressed attribute should have a valid compression method ID. These checks are cheap. Actually retrieving the compressed toasted data and checking that it uncompresses correctly would have very different performance implications, but that is not included in this patch.
Commits
-
Remove tests added by bd807be6935929bdefe74d1258ca08048f0aafa3.
- ccf289745d3e 15.0 landed
-
amcheck: Add additional TOAST pointer checks.
- bd807be69359 15.0 landed