Re: COPY FROM performance improvements
Andrew Dunstan <andrew@dunslane.net>
From: Andrew Dunstan <andrew@dunslane.net>
To: Alon Goldshuv <agoldshuv@greenplum.com>
Cc: pgsql-patches@postgresql.org
Date: 2005-07-19T15:23:18Z
Lists: pgsql-performance
Alon Goldshuv wrote: >I revisited my patch and removed the code duplications that were there, and >added support for CSV with buffered input, so CSV now runs faster too >(although it is not as optimized as the TEXT format parsing). So now >TEXT,CSV and BINARY are all parsed in CopyFrom(), like in the original file. > >Patch attached. > > > I do not have time to review this 2900 line patch analytically, nor to benchmark it. I have done some functional testing of it on Windows, and tried to break it in text and CSV modes, and with both Unix and Windows type line endings - I have not observed any breakage. This does need lots of eyeballs, though. cheers andrew