Re: realtime data inserts
Jim C. Nasby <jim@nasby.net>
From: "Jim C. Nasby" <jim@nasby.net>
To: Adam Siegel <adam@sycamorehq.com>
Cc: pgsql-hackers@postgresql.org, pgsql-performance@postgresql.org, pgsql-general@postgresql.org
Date: 2003-05-10T17:08:33Z
Lists: pgsql-hackers, pgsql-performance, pgsql-general
Are you binding your insert? IE: prepare statement INSERT INTO blah VALUES (?, ?, ?); execute statement (a, b, c) Instead of just "INSERT INTO blah VALUES(a, b, c)" On Sat, May 10, 2003 at 11:25:16AM -0400, Adam Siegel wrote: > I have realtime data flowing at a rate of 500, 512 byte packets per second. > I want to log the info in a database table with two other columns, one for a > timestamp and one for a name of the packet. The max rate I can achieve is > 350 inserts per second on a sun blade 2000. The inserts are grouped in a > transaction and I commit every 1200 records. I am storing the binary data > in a bytea. I am using the libpq conversion function. Not sure if that is > slowing me down. But I think it is the insert not the conversion. > > Any thoughts on how to achive this goal? -- Jim C. Nasby (aka Decibel!) jim@nasby.net Member: Triangle Fraternity, Sports Car Club of America Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?"