Re: realtime data inserts

Jim C. Nasby <jim@nasby.net>

From: "Jim C. Nasby" <jim@nasby.net>
To: Adam Siegel <adam@sycamorehq.com>
Cc: pgsql-hackers@postgresql.org, pgsql-performance@postgresql.org, pgsql-general@postgresql.org
Date: 2003-05-10T17:08:33Z
Lists: pgsql-hackers, pgsql-performance, pgsql-general
Are you binding your insert? IE:

prepare statement INSERT INTO blah VALUES (?, ?, ?);

execute statement (a, b, c)

Instead of just "INSERT INTO blah VALUES(a, b, c)"


On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote:
> I have realtime data flowing at a rate of 500, 512 byte packets per second.
> I want to log the info in a database table with two other columns, one for a
> timestamp and one for a name of the packet.  The max rate I can achieve is
> 350 inserts per second on a sun blade 2000.  The inserts are grouped in a
> transaction and I commit every 1200 records.  I am storing the binary data
> in a bytea.  I am using the libpq conversion function.  Not sure if that is
> slowing me down.  But I think it is the insert not the conversion.
> 
> Any thoughts on how to achive this goal?
 

-- 
Jim C. Nasby (aka Decibel!)                    jim@nasby.net
Member: Triangle Fraternity, Sports Car Club of America
Give your computer some brain candy! www.distributed.net Team #1828

Windows: "Where do you want to go today?"
Linux: "Where do you want to go tomorrow?"
FreeBSD: "Are you guys coming, or what?"