Extending amcheck to check toast size and compression

Mark Dilger <mark.dilger@enterprisedb.com>

From: Mark Dilger <mark.dilger@enterprisedb.com>
To: PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2021-05-04T16:20:00Z
Lists: pgsql-hackers

Attachments

Hackers,

During the version 14 development period, a few checks of toasted attributes were written but never committed.  For the version 15 development cycle, I'd like to consider extending the checks of toasted attributes.  First, no toasted attribute should ever have a rawsize larger than the 1GB varlena limit.  Second, no compressed toasted attribute should have an extsize indicating that the toast expanded during toasting.  Such a extsize could mean the compression code is malfunctioning, or that the extsize or rawsize fields are corrupt.  Third, any compressed attribute should have a valid compression method ID.

These checks are cheap.  Actually retrieving the compressed toasted data and checking that it uncompresses correctly would have very different performance implications, but that is not included in this patch.

Commits

  1. Remove tests added by bd807be6935929bdefe74d1258ca08048f0aafa3.

  2. amcheck: Add additional TOAST pointer checks.