Horton

Re: Bulkloading using COPY - ignore duplicates?

Zeugswetter Andreas ADI SD <zeugswettera@spardat.at>

View thread
From: "Zeugswetter Andreas SB SD" <ZeugswetterA@spardat.at>
To: "Thomas Swan" <tswan@olemiss.edu>, "Lee Kindness" <lkindness@csl.co.uk>
Cc: "Tom Lane" <tgl@sss.pgh.pa.us>, <pgsql-hackers@postgresql.org>
Date: 2001-10-01T14:39:36Z
Lists: pgsql-hackers 
> IMHO, you should copy into a temporary table and the do a select 
> distinct from it into the table that you want.

Which would be way too slow for normal operation :-(
We are talking about a "fast as possible" data load from a flat file
that may have duplicates (or even data errors, but that 
is another issue).

Andreas