Re: Bug in UTF8-Validation Code?
Andrew Dunstan <andrew@dunslane.net>
From: Andrew Dunstan <andrew@dunslane.net>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Jeff Davis <pgsql@j-davis.com>, Michael Fuhr <mike@fuhr.org>, Mario Weilguni <mweilguni@sime.com>, "Joshua D. Drake" <jd@commandprompt.com>, Albe Laurenz <all@adv.magwien.gv.at>, pgsql-hackers@postgresql.org
Date: 2007-03-17T16:23:07Z
Lists: pgsql-hackers
Tom Lane wrote: > Andrew Dunstan <andrew@dunslane.net> writes: > >> Last year Jeff suggested adding something like: >> pg_verifymbstr(string,strlen(string),0); >> to each relevant input routine. Would that be an acceptable solution? >> > > The problem with that is that it duplicates effort: in many cases > (especially COPY IN) the data's already been validated. I'm not sure > how to fix that, but I think you'll get some push-back if you double > the encoding verification work in COPY for nothing. > > Given that we are moving away from backslash-enabled literals, I'm > not as convinced as some that this must be fixed... > > > > They will still be available in E'\nn' form, won't they? One thought I had was that it might make sense to have a flag that would inhibit the check, that could be set (and reset) by routines that check for themselves, such as COPY IN. Then bulk load performance should not be hit much. cheers andrew