Re: pg_verify_checksums and -fno-strict-aliasing
Andres Freund <andres@anarazel.de>
From: Andres Freund <andres@anarazel.de>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Michael Banck <michael.banck@credativ.de>, Magnus Hagander <magnus@hagander.net>, Fabien COELHO <coelho@cri.ensmp.fr>, pgsql-hackers <pgsql-hackers@postgresql.org>
Date: 2018-08-30T22:33:15Z
Lists: pgsql-hackers
On 2018-08-30 18:11:40 -0400, Tom Lane wrote: > Andres Freund <andres@anarazel.de> writes: > > On 2018-08-30 14:46:06 -0700, Andres Freund wrote: > >> One way to fix it would be to memcpy in/out the modified PageHeader, or > >> just do offset math and memcpy to that offset. > > > It took me a bit to reproduce the issue (due to sheer stupidity on my > > part: no, changing the flags passed to gcc to link pg_verify_checksums > > doesn't do the trick), but the above indeed fixes the issue for me. > > I suspect people will complain about the added cost of doing that. I think the compiler will just optimize it away. But if we're concerned we could write it as memcpy(&save_checksum, page + offsetof(PageHeaderData, pd_checksum), sizeof(save_checksum)); memset(page + offsetof(PageHeaderData, pd_checksum), 0, sizeof(save_checksum)); checksum = pg_checksum_block(page, BLCKSZ); memcpy(page + offsetof(PageHeaderData, pd_checksum), &save_checksum, sizeof(save_checksum)); works, but still not exceedingly pretty :/. The code generated looks reasonable: 194 memcpy(&save_checksum, page + offsetof(PageHeaderData, pd_checksum), sizeof(save_checksum)); 0x00000000000035d0 <+0>: push %r12 0x00000000000035d2 <+2>: xor %eax,%eax 0x00000000000035d4 <+4>: movzwl 0x8(%rdi),%r12d 195 memset(page + offsetof(PageHeaderData, pd_checksum), 0, sizeof(save_checksum)); 0x00000000000035d9 <+9>: push %rbp 0x00000000000035da <+10>: mov %ax,0x8(%rdi) (the pushes are just interspersed stuff, yay latency aware instruction scheduling) > I've been AFK all afternoon, but what I was intending to try next was > the union approach, specifically union'ing PageHeaderData with the uint32 > array representation needed by pg_checksum_block(). That might also > end up giving us code less unreadable than this: > > uint32 (*dataArr)[N_SUMS] = (uint32 (*)[N_SUMS]) data; Hm. > BTW, not to mention the elephant in the room, but: is it *really* OK > that pg_checksum_page scribbles on the page buffer, even temporarily? > It's certainly quite horrid that there aren't large warnings about > that in the function's API comment. It certainly should be warned about. Practically I don't think it's a problem, because we pretty much always operate on a copy of the page when writing out, as otherwise concurrently set hint bits would be troublesome. Greetings, Andres Freund
Commits
-
Avoid using potentially-under-aligned page buffers.
- 44cac9346479 12.0 landed
- 5af055ed7446 9.3.25 landed
- f5c93cf92223 11.0 landed
- 826980424538 9.6.11 landed
- 10b9af3ebbed 10.6 landed
- 083d9ced14e4 9.4.20 landed
- 03ffe5553c1d 9.5.15 landed
-
Code review for pg_verify_checksums.c.
- d787af7badfe 11.0 landed
- d9c366f9e801 12.0 landed
-
Make checksum_impl.h safe to compile with -fstrict-aliasing.
- db87d3b5253f 9.3.25 landed
- 20f9cd55dd53 9.4.20 landed
- 853af991e35a 9.5.15 landed
- d6ef17ed7bba 9.6.11 landed
- c2dfbd18ce25 10.6 landed
- 9daff2fe69dc 11.0 landed
- 8c62d9d16f01 12.0 landed