Horton

Re: Perform COPY FROM encoding conversions in larger chunks

John Naylor <john.naylor@enterprisedb.com>

View thread View on postgr.es
From: John Naylor <john.naylor@enterprisedb.com>
To: Heikki Linnakangas <hlinnaka@iki.fi>
Cc: pgsql-hackers <pgsql-hackers@postgresql.org>
Date: 2021-03-18T16:58:03Z
Lists: pgsql-hackers

Attachments

On Tue, Feb 9, 2021 at 1:44 PM Heikki Linnakangas <hlinnaka@iki.fi> wrote:
> > Fixed. And also fixed one more bug in allocating raw_buf_size, the "+ 1"
> > somehow went missing again. That was causing a failure on Windows at
> > cfbot.cputube.org.
> >
> > I'll read through this one more time with fresh eyes tomorrow or the day
> > after, and push. Thanks for all the review!
>
> Forgot attachment..
>
> - Heikki

I went ahead and rebased these.

--
John Naylor
EDB: http://www.enterprisedb.com

Commits

  1. Do COPY FROM encoding conversion/verification in larger chunks.

  2. Add 'noError' argument to encoding conversion functions.

  3. Add direct conversion routines between EUC_TW and Big5.

  4. Add mbverifystr() functions specific to each encoding.