Re: Postgresql JDBC process consumes more memory with partition tables update delete

Dave Cramer <davecramer@postgres.rocks>

From: Dave Cramer <davecramer@postgres.rocks>
To: "James Pang (chaolpan)" <chaolpan@cisco.com>
Cc: Vladimir Sitnikov <sitnikov.vladimir@gmail.com>, "pgsql-jdbc@lists.postgresql.org" <pgsql-jdbc@lists.postgresql.org>
Date: 2022-09-08T09:31:15Z
Lists: pgsql-performance
On Thu, 8 Sept 2022 at 04:36, James Pang (chaolpan) <chaolpan@cisco.com>
wrote:

>
>
> Please check attached.  Removed some dbname and tablename , the
> interesting thing is we only see this issue by JDBC driver client, for psql
> client , only 25MB memory and similar SQL plan used.
>
>
>
> Thanks,
>
> James
>
> *From:* Vladimir Sitnikov <sitnikov.vladimir@gmail.com>
> *Sent:* Thursday, September 8, 2022 3:05 PM
> *To:* James Pang (chaolpan) <chaolpan@cisco.com>
> *Cc:* pgsql-jdbc@lists.postgresql.org
> *Subject:* Re: Postgresql JDBC process consumes more memory with
> partition tables update delete
>
>
>
> > > Yesterday, when workload test, a lot of Postgresql JDBC connections
> > > use 150-160MB memory , so we got ERROR: out of memory
>
> Would you please share a reproducer? (e.g. DDL for the table, test code)
>
>
>
> Have you tried capturing memory context information for the backend that
> consumes memory?
>
> https://wiki.postgresql.org/wiki/Developer_FAQ#Examining_backend_memory_use
>
> Vladimir
>


I'd like to see the actual statement for each. Can you turn on log all
statements in the back end and capture the actual statement for psql and
jdbc ?


Dave Cramer
www.postgres.rocks

Commits

Same data as JSON: GET /api/v1/messages/:b64id/commits the thread's linked commits as JSON, with link sources. API reference →
  1. Fix recovery_prefetch with low maintenance_io_concurrency.