Re: realtime data inserts

Adam Siegel <adam@sycamore.us>

From: Adam Siegel <adam@sycamore.us>
To: "Jim C. Nasby" <jim@nasby.net>
Cc: pgsql-hackers@postgresql.org, <pgsql-performance@postgresql.org>, <pgsql-general@postgresql.org>
Date: 2003-05-12T14:51:17Z
Lists: pgsql-hackers, pgsql-performance, pgsql-general
The copy from method (PQputline) allows me to achieve around 1000 inserts 
per second. 


On Sat, 10 May 2003, Jim C. Nasby wrote:

> Are you binding your insert? IE:
> 
> prepare statement INSERT INTO blah VALUES (?, ?, ?);
> 
> execute statement (a, b, c)
> 
> Instead of just "INSERT INTO blah VALUES(a, b, c)"
> 
> 
> On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> > I have realtime data flowing at a rate of 500, 512 byte packets per second.
> > I want to log the info in a database table with two other columns, one for a
> > timestamp and one for a name of the packet.  The max rate I can achieve is
> > 350 inserts per second on a sun blade 2000.  The inserts are grouped in a
> > transaction and I commit every 1200 records.  I am storing the binary data
> > in a bytea.  I am using the libpq conversion function.  Not sure if that is
> > slowing me down.  But I think it is the insert not the conversion.
> > 
> > Any thoughts on how to achive this goal?
>  
> 
>