Re: Introduce pg_receivewal gzip compression tests
Michael Paquier <michael@paquier.xyz>
From: Michael Paquier <michael@paquier.xyz>
To: gkokolatos@pm.me
Cc: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2021-07-15T12:35:52Z
Lists: pgsql-hackers
On Thu, Jul 15, 2021 at 08:35:27PM +0900, Michael Paquier wrote: > 1) bowerbird on Windows/MSVC: > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=bowerbird&dt=2021-07-15%2010%3A30%3A36 > pg_receivewal: fatal: could not fsync existing write-ahead log file > "000000010000000000000002.partial": Permission denied > not ok 20 - streaming some WAL using ZLIB compression > I don't think the existing code can be blamed for that as this means a > failure with gzflush(). Likely a concurrency issue as that's an > EACCES. If that's repeatable, that could point to an actual issue > with pg_receivewal --compress. For this one, I'll try to test harder on my own host. I am curious to see if the other Windows members running the TAP tests have anything to say. Looking at the code of zlib, this would come from gz_zero() in gzflush(), which could blow up on a write() in gz_comp(). > 2) curculio: > > Looking at the OpenBSD code (usr.bin/compress/main.c), long options > are supported, where --version does exit(0) without printing > anything, and --test is supported even if that's not on the man pages. > set_outfile() is doing a discard of the file suffixes it does not > recognize, and I think that their implementation bumps on .gz.partial > and generates an exit code of 512 to map with WARNING. I still wish > to keep this test, and I'd like to think that the contents of > @zlib_wals are enough in terms of coverage. What do you think? After thinking more about this one, I have taken the course to just remove the .gz.partial segment from the check, a full segment should be enough in terms of coverage. I prefer this simplification over a rename of the .partial segment or a tweak of the error code to map with WARNING. -- Michael
Commits
-
Re-enable TAP tests of pg_receivewal for ZLIB on Windows
- 91d395f47aa9 15.0 landed
-
Fix some issues with WAL segment opening for pg_receivewal --compress
- 11dbad74c104 10.18 landed
- 795a9166e2e1 11.13 landed
- b9a0de15eb29 12.8 landed
- fb2b86015a9f 13.4 landed
- 3a0d2d0cbaf3 14.0 landed
- 7fbe0c8c4d4f 15.0 landed
-
Disable tests involving ZLIB on Windows for pg_receivewal
- 6cea447e6a10 15.0 landed
-
Fix portability issue with gzip in TAP test of pg_receivewal
- 0da3c1bc3f72 15.0 landed
-
Add TAP tests for ZLIB compression for pg_receivewal
- ffc9ddaea33f 15.0 landed