Re: Storing thousands of csv files in postgresql
Marcos Pegoraro <marcos@f10.com.br>
From: Marcos Pegoraro <marcos@f10.com.br>
To: Erik Brandsberg <erik@heimdalldata.com>
Cc: Ion Alberdi <ion.alberdi@pricemoov.com>,
pgsql-sql <pgsql-sql@lists.postgresql.org>
Date: 2022-02-15T20:27:31Z
Lists: pgsql-sql
> > I'm going to challenge that the question is not one for Postgres, but you > should be asking "What filesystem is best suited to having many files in > the same directory" and let the technology deal with the problem. Postgres > is just dependent on the filesystem for this behavior. And to that answer, > I believe, is XFS. > > He didn't say how many different schemas will have. All those thousands of CSV files have a completely unknown structure ? Or you'll have just dozens or hundreds of structures ? Marcos