Re: Use pg_pwritev_with_retry() instead of write() in dir_open_for_write() to avoid partial writes?
Thomas Munro <thomas.munro@gmail.com>
From: Thomas Munro <thomas.munro@gmail.com>
To: Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Cc: Nathan Bossart <nathandbossart@gmail.com>,
Michael Paquier <michael@paquier.xyz>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2022-09-27T09:30:22Z
Lists: pgsql-hackers
Attachments
- 0001-Restore-pg_pread-and-friends.txt (text/plain)
On Tue, Sep 27, 2022 at 6:43 PM Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com> wrote: > On Tue, Sep 27, 2022 at 3:08 AM Thomas Munro <thomas.munro@gmail.com> wrote: > > > > I don't think so, that's an extra kernel call. I think I'll just have > > to revert part of my recent change that removed the pg_ prefix from > > those function names in our code, and restore the comment that warns > > you about the portability hazard (I thought it went away with HP-UX > > 10, where we were literally calling lseek() before every write()). > > The majority of users of these functions don't intermix them with > > calls to read()/write(), so they don't care about the file position, > > so I think it's just something we'll have to continue to be mindful of > > in the places that do. > > Yes, all of the existing pwrite() callers don't care about the file > position, but the new callers such as the actual idea and patch > proposed here in this thread cares. > > Is this the commit cf112c122060568aa06efe4e6e6fb9b2dd4f1090 part of > which [1] you're planning to revert? Yeah, just the renaming parts of that. The lseek()-based emulation is definitely not coming back. Something like the attached.
Commits
-
Revise pg_pwrite_zeros()
- ce340e530d1f 16.0 landed
-
Use pg_pwrite_zeros() in walmethods.c
- 28cc2976a9cf 16.0 landed
-
Introduce pg_pwrite_zeros() in fileutils.c
- 3bdbdf5d06f2 16.0 landed
-
Move pg_pwritev_with_retry() to src/common/file_utils.c
- 4ab8c81bd90a 16.0 landed
-
Restore pg_pread and friends.
- b6d8a60aba32 16.0 landed
-
Remove dead pread and pwrite replacement code.
- cf112c122060 16.0 cited