Re: Bulkloading using COPY - ignore duplicates?
Thomas Swan <tswan@olemiss.edu>
From: Thomas Swan <tswan@olemiss.edu>
To: Zeugswetter Andreas SB SD <ZeugswetterA@spardat.at>
Cc: Lee Kindness <lkindness@csl.co.uk>, Tom Lane <tgl@sss.pgh.pa.us>, pgsql-hackers@postgresql.org
Date: 2001-10-01T14:42:56Z
Lists: pgsql-hackers
Zeugswetter Andreas SB SD wrote: >>IMHO, you should copy into a temporary table and the do a select >>distinct from it into the table that you want. >> > >Which would be way too slow for normal operation :-( >We are talking about a "fast as possible" data load from a flat file >that may have duplicates (or even data errors, but that >is another issue). > >Andreas > Then the IGNORE_DUPLICATE would definitely be the way to go, if speed is the question...