In psql \copy from, send data to server in larger chunks.

Heikki Linnakangas <heikki.linnakangas@iki.fi>

Commit: eec57115e4c866f26bdc8bcbe3e2e7be4c6d0450
Author: Heikki Linnakangas <heikki.linnakangas@iki.fi>
Date: 2021-07-14T10:08:28Z
Releases: 15.0
In psql \copy from, send data to server in larger chunks.

Previously, we would send each line as a separate CopyData message.
That's pretty wasteful if the table is narrow, as each CopyData message
has 5 bytes of overhead. For efficiency, buffer up and pack 8 kB of
input data into each CopyData message.

The server also sends each line as a separate CopyData message in COPY TO
STDOUT, and that's similarly wasteful. But that's documented in the FE/BE
protocol description, so changing that would be a wire protocol break.

Reviewed-by: Aleksander Alekseev
Discussion: https://www.postgresql.org/message-id/40b2cec0-d0fb-3191-2ae1-9a3fe16a7e48%40iki.fi

Files

PathChange+/−
src/bin/psql/copy.c modified +56 −43

Discussion