Re: Bulkloading using COPY - ignore duplicates?

Thomas Swan <tswan@olemiss.edu>

From: Thomas Swan <tswan@olemiss.edu>
To: Zeugswetter Andreas SB SD <ZeugswetterA@spardat.at>
Cc: Lee Kindness <lkindness@csl.co.uk>, Tom Lane <tgl@sss.pgh.pa.us>, pgsql-hackers@postgresql.org
Date: 2001-10-01T14:42:56Z
Lists: pgsql-hackers
Zeugswetter Andreas SB SD wrote:

>>IMHO, you should copy into a temporary table and the do a select 
>>distinct from it into the table that you want.
>>
>
>Which would be way too slow for normal operation :-(
>We are talking about a "fast as possible" data load from a flat file
>that may have duplicates (or even data errors, but that 
>is another issue).
>
>Andreas
>
Then the IGNORE_DUPLICATE would definitely be the way to go, if speed is 
the question...