Thread

Re: PoC: pg_dump --filter-data <file> (like Oracle Where Clause on RMAN for specific tables)

Kirk Wolak <wolakk@gmail.com> — 2025-08-16T22:48:41Z

On Fri, Aug 15, 2025 at 12:37 PM Tom Lane <tgl@sss.pgh.pa.us> wrote:

> Kirk Wolak <wolakk@gmail.com> writes:
> >   We have a handful of tables that have 90% of the data going back 30
> years.
> > We NEVER restore this data to Dev or Staging.  We used a special RMAN
> > backup where these tables had a "WHERE clause" applied to them during the
> > backup/dump process.
>
> Have you considered partitioning these tables by date and then not
> dumping the older partitions?  That would fit into existing
> functionality a lot better.
>

>                         regards, tom lane
>

I had not considered it until now.  But because we are talking about only
keeping 7 - 28 days of decades of data.
I would assume that window would require a bit of work in production to
maintain, making it a tough sell to the client.