Re: Streaming I/O, vectored I/O (WIP)

Thomas Munro <thomas.munro@gmail.com>

From: Thomas Munro <thomas.munro@gmail.com>

To: Dilip Kumar <dilipbalaut@gmail.com>

Cc: Robert Haas <robertmhaas@gmail.com>, Heikki Linnakangas <hlinnaka@iki.fi>, pgsql-hackers <pgsql-hackers@postgresql.org>, Melanie Plageman <melanieplageman@gmail.com>, Andres Freund <andres@anarazel.de>

Date: 2024-03-15T23:52:59Z

Lists: pgsql-hackers

I am planning to push the bufmgr.c patch soon.  At that point the new
API won't have any direct callers yet, but the traditional
ReadBuffer() family of functions will internally reach
StartReadBuffers(nblocks=1) followed by WaitReadBuffers(),
ZeroBuffer() or nothing as appropriate.  Any more thoughts or
objections?  Naming, semantics, correctness of buffer protocol,
sufficiency of comments, something else?

Commits

Fix typos and incorrect type in read_stream.c
- 2ea4b2927722 17.0 landed
Use streaming I/O in pg_prewarm.
- 3a352df05e65 17.0 landed
Provide API for streaming relation data.
- b5a9b18cd0bc 17.0 landed
Provide vectored variant of ReadBuffer().
- 210622c60e1a 17.0 landed
Provide vectored variants of smgrread() and smgrwrite().
- 4908c5872059 17.0 landed
Provide multi-block smgrprefetch().
- b485ad7f07c8 17.0 landed
Provide vectored variants of FileRead() and FileWrite().
- 871fe4917e1e 17.0 landed
Provide helper for retrying partial vectored I/O.
- 0c6be59f5e34 17.0 landed
Optimize pg_readv/pg_pwritev single vector case.
- 15c9ac362993 17.0 landed
bufmgr: Support multiple in-progress IOs by using resowner
- 12f3867f5534 16.0 cited