Re: realtime data inserts
Adam Siegel <adam@sycamore.us>
From: Adam Siegel <adam@sycamore.us>
To: "Jim C. Nasby" <jim@nasby.net>
Cc: pgsql-hackers@postgresql.org, <pgsql-performance@postgresql.org>, <pgsql-general@postgresql.org>
Date: 2003-05-12T14:51:17Z
Lists: pgsql-hackers, pgsql-performance, pgsql-general
The copy from method (PQputline) allows me to achieve around 1000 inserts per second. On Sat, 10 May 2003, Jim C. Nasby wrote: > Are you binding your insert? IE: > > prepare statement INSERT INTO blah VALUES (?, ?, ?); > > execute statement (a, b, c) > > Instead of just "INSERT INTO blah VALUES(a, b, c)" > > > On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote: > > I have realtime data flowing at a rate of 500, 512 byte packets per second. > > I want to log the info in a database table with two other columns, one for a > > timestamp and one for a name of the packet. The max rate I can achieve is > > 350 inserts per second on a sun blade 2000. The inserts are grouped in a > > transaction and I commit every 1200 records. I am storing the binary data > > in a bytea. I am using the libpq conversion function. Not sure if that is > > slowing me down. But I think it is the insert not the conversion. > > > > Any thoughts on how to achive this goal? > > >