Re: parallel data loading for pgbench -i

Mircea Cadariu <cadariu.mircea@gmail.com>

From: Mircea Cadariu <cadariu.mircea@gmail.com>

To: Heikki Linnakangas <hlinnaka@iki.fi>, lakshmi <lakshmigcdac@gmail.com>

Cc: "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>, "tomas@vondra.me" <tomas@vondra.me>

Date: 2026-04-10T18:37:09Z

Lists: pgsql-hackers

Attachments

v3-0001-pgbench-parallelize-account-loading-for-range-partit.patch (text/plain) patch v3-0001

Hi,

On 07/04/2026 10:00, Heikki Linnakangas wrote:
>
> This all makes more sense in the partitioned case. Perhaps we should 
> parallelize only when partitioned are used, and use only one thread 
> per partition.
>
Thanks for having a look. I attached v3 that parallelizes only the 
partitioned case, one thread per partition. Results:


patch:

pgbench -i -s 100 --partitions 10

done in 12.63 s (drop tables 0.05 s, create tables 0.01 s, client-side 
generate 5.98 s, vacuum 1.63 s, primary keys 4.96 s).


master:

pgbench -i -s 100 --partitions 10

done in 29.29 s (drop tables 0.00 s, create tables 0.02 s, client-side 
generate 16.31 s, vacuum 7.78 s, primary keys 5.18 s).

-- 
Thanks,
Mircea Cadariu