Horton

Re: COPY FROM performance improvements

Mark Wong <markw@osdl.org>

View thread View on postgr.es
From: Mark Wong <markw@osdl.org>
To: "Luke Lonergan" <llonergan@greenplum.com>
Cc: "Andrew Dunstan" <andrew@dunslane.net>, "Alvaro Herrera" <alvherre@surnet.cl>, "Bruce Momjian" <pgman@candle.pha.pa.us>, "Alon Goldshuv" <agoldshuv@greenplum.com>, pgsql-patches@postgresql.org, maryedie@osdl.org
Date: 2005-07-21T21:55:07Z
Lists: pgsql-performance 
I just ran through a few tests with the v14 patch against 100GB of data
from dbt3 and found a 30% improvement; 3.6 hours vs 5.3 hours.  Just to
give a few details, I only loaded data and started a COPY in parallel
for each the data files:
	http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/

Here's a visual of my disk layout, for those familiar with the database schema:
	http://www.testing.osdl.org/projects/dbt3testing/results/fast_copy/layout-dev4-010-dbt3.html

I have 6 arrays of fourteen 15k rpm drives in a split-bus configuration
attached to a 4-way itanium2 via 6 compaq smartarray pci-x controllers.

Let me know if you have any questions.

Mark