Re: [PATCH] Completed unaccent dictionary with many missing characters

Przemysław Sztoch <przemyslaw@sztoch.pl>

From: Przemysław Sztoch <przemyslaw@sztoch.pl>
To: Thomas Munro <thomas.munro@gmail.com>
Cc: Michael Paquier <michael@paquier.xyz>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>, Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Date: 2022-06-21T13:41:48Z
Lists: pgsql-hackers
Thomas Munro wrote on 21.06.2022 02:53:
> On Tue, Jun 21, 2022 at 12:11 PM Michael Paquier <michael@paquier.xyz> wrote:
>> Yeah, Latin-ASCII.xml is getting it wrong here, then.  unaccent
>> fetches the thing from this URL currently:
>> https://raw.githubusercontent.com/unicode-org/cldr/release-41/common/transforms/Latin-ASCII.xml
> Oh, we're using CLDR 41, which reminds me: CLDR 36 added SOUND
> RECORDING COPYRIGHT[1] so we could drop it from special_cases().
>
> Hmm, is it possible to get rid of CYRILLIC CAPITAL LETTER IO and
> CYRILLIC SMALL LETTER IO by adding Cyrillic to PLAIN_LETTER_RANGES?
>
> That'd leave just DEGREE CELSIUS and DEGREE FAHRENHEIT.  Not sure how
> to kill those last two special cases -- they should be directly
> replaced by their decomposition.
>
> [1] https://unicode-org.atlassian.net/browse/CLDR-11383
I patch v3 support for cirilic is added.
Special character function has been purged.
Added support for category: So - Other Symbol. This category include 
characters from special_cases().

-- 
Przemysław Sztoch | Mobile +48 509 99 00 66

Commits

  1. Simplify a bit the special rules generating unaccent.rules