Re: BUG #19354: JOHAB rejects valid byte sequences
Thomas Munro <thomas.munro@gmail.com>
From: Thomas Munro <thomas.munro@gmail.com>
To: Robert Haas <robertmhaas@gmail.com>
Cc: Tom Lane <tgl@sss.pgh.pa.us>, Jeroen Vermeulen <jtvjtv@gmail.com>, VASUKI M <vasukianand0119@gmail.com>, pgsql-bugs@lists.postgresql.org
Date: 2026-04-14T06:30:08Z
Lists: pgsql-bugs
Attachments
- 0001-Remove-JOHAB-encoding.patch.gz (application/gzip) patch 0001
On Wed, Dec 17, 2025 at 7:43 AM Robert Haas <robertmhaas@gmail.com> wrote: > I think there is a good chance that the right going-forward fix is to > deprecate the encoding, because according to > https://www.unicode.org/Public/MAPPINGS/EASTASIA/ReadMe.txt this and > everything else that's now under > https://www.unicode.org/Public/MAPPINGS/OBSOLETE/EASTASIA/ were > deprecated in 2001. By the time v19 is released, the deprecation will > be a quarter-century old, and the fact that it doesn't work is good > evidence that few people will miss it, though perhaps the original > poster will want to put forward an argument for why we should still > care about this. Right, that stuff was withdrawn, along with the BIG5 and JIS X 0212 mappings (here's some interesting discussion about their normative status[1]). From what I can figure out, JOHAB was an MS-DOS codepage (1361), obsoleted by UHC (949) some time around MS-DOS 6.22 or MS-DOS 7 and Windows 95. So +1 from me, set the phasers to git rm. Based on the comments for enum pg_enc, we don't need to worry about numerical stability of client-only encodings, so I just deleted it (unlike PG_MULE_INTERNAL which became PG_UNUSED_1). I didn't mention it in doc/src/sgml/appendix-obsolete.sgml: the decision criterion for that seems to be that there was an SGML id that appeared in a URL, which is not the case here. The release notes seem like enough of a tombstone for something that we strongly suspect has 0 users. Wait until 20, or just do it now? I don't have an opinion yet whether the code in the back-branches might be dangerous, or "fixing" it might be more dangerous, but it's an interesting question... [1] https://unicode.org/mail-arch/unicode-ml/y2002-m03/0691.html
Commits
Same data as JSON:
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
Fix comments for Korean encodings in encnames.c
- e5fb1ff5bed9 14.23 landed
- 78f8fbc8ab5f 15.18 landed
- 5ef61f417f17 16.14 landed
- ec61832231c4 17.10 landed
- ea94d2e6734e 18.4 landed
- 9a618901a476 19 (unreleased) landed
-
Fix the inadvertent libpq ABI breakage discovered by Martin Pitt: the
- 8468146b03c8 8.3.0 cited
-
> Tatsuo Ishii wrote:
- a8bd7e1c6e02 7.3.1 cited