Re: PARALLEL CTAS

The issue is there are certain performance benefits to be had by doing parallel CTAS operations and when converting from Oracle to PostgreSQL switching to a “COPY” operation isn’t feasible.
---

Thanks,


Shane Borden
sborden76@gmail.com

> On Dec 12, 2022, at 11:55 AM, Erik Brandsberg <erik@heimdalldata.com> wrote:
> 
> Copy operations are by far the most efficient way to do bulk loads.  The fdw extension isn't very efficient based on prior experience.
> 
> On Mon, Dec 12, 2022 at 11:17 AM Shane Borden <sborden76@gmail.com <mailto:sborden76@gmail.com>> wrote:
>> Based on testing thus far, it appears that the only way to get a bulk load operation (similar to oracle) would be to use the COPY command or to use multiple connections and break up the inserts across connections.  I did see a possibility of using the postgres_fdw extension and use the batch functionality, but I haven’t tested that yet.
>> 
>> Does anyone know the status of this feature / patch that was discussed in this link?
>> 
>> https://www.postgresql.org/message-id/CAJcOf-cXnB5cnMKqWEp2E2z7Mvcd04iLVmV%3DqpFJrR3AcrTS3g%40mail.gmail.com
>> 
>> Is there a way in PostgreSQL to parallelize a CTAS statement similar to how you can do it in Oracle?
>> 
>> ---
>> 
>> Thanks,
>> 
>> 
>> Shane Borden
>> sborden76@gmail.com <mailto:sborden76@gmail.com>