Horton

Re: UTF8 with BOM support in psql

Kevin Grittner <kevin.grittner@wicourts.gov>

View thread View on postgr.es
From: "Kevin Grittner" <Kevin.Grittner@wicourts.gov>
To: "Andrew Dunstan" <andrew@dunslane.net>, "Tom Lane" <tgl@sss.pgh.pa.us>
Cc: "Bruce Momjian" <bruce@momjian.us>, "Itagaki Takahiro" <itagaki.takahiro@oss.ntt.co.jp>, <pgsql-hackers@postgresql.org>
Date: 2009-10-20T15:54:49Z
Lists: pgsql-hackers 
Andrew Dunstan <andrew@dunslane.net> wrote:
 
> What I think we might sensibly do is to eat the leading BOM of an
> SQL file iff the client encoding is UTF8, and otherwise treat it as
> just bytes in whatever the encoding is.
 
Only at the beginning of the file or stream?  What happens when people
concatenate files?  Would it make sense to treat BOM as whitespace in
UTF-8, or maybe ignore it entirely?
 
-Kevin