Re: COPY problem
Gordon A. Runkle <gar@no-spam-integrated-dynamics.com>
From: "Gordon A. Runkle" <gar@no-spam-integrated-dynamics.com>
To: pgsql-general@postgresql.org
Date: 2001-03-10T02:18:28Z
Lists: pgsql-general
In article <10FE17AD5F7ED31188CE002048406DE8514CEE@lsv-msg06.stortek.com>, "Creager, Robert S" <CreagRS@louisville.stortek.com> wrote: > I think this is a question regarding the backend, but... [snip] > (COPY u FROM stdin). The backend process which handles the db connection > decides that it needs a whole lot of memory, although in a nice > controlled manner. The backend starts with using 6.5Mb, and at 25000 > records copied, it's taken 10Mb and has slowed down substantially. > Needless to say, this COPY will not finish before running out of memory > (estimated 300Mb). When executing the COPY to the loc table, this > problem does not occur. Am I going to have to resort to inserts for the > referring tables? I can't answer the backend question, but how about running 'split' on the big file, then COPYing these smaller files? Gordon. -- It doesn't get any easier, you just go faster. -- Greg LeMond