MBOX-Line: From tss at iki.fi  Fri Sep 14 12:52:54 2012
To: imap-protocol@u.washington.edu
From: Timo Sirainen <tss@iki.fi>
Date: Fri Jun  8 12:34:48 2018
Subject: [Imap-protocol] Comparators?
In-Reply-To: <504E328F.7030000@isode.com>
References: <25F5C770-A983-40E7-A075-87A27449240F@iki.fi>
	<504E328F.7030000@isode.com>
Message-ID: <D20A4AB1-42CA-4AB4-B481-FEFBA5D4AC9D@iki.fi>

On 10.9.2012, at 21.33, Alexey Melnikov wrote:

>> I'm mainly wondering how to add support for languages where the acutes/graves in letters should be ignored by searches.
> If you write it down, I will review and can find other reviewers. I don't think this is the first time this was proposed, so maybe there is some utility in it.

Looks like i;unicode-casemap could already optionally do that, according to its security section:

>    2) Step (2)(b) defines a subset of Normalization Form KD (NFKD) that
>       does not require normalization of out-of-order diacriticals.
>       However, an implementation MAY use an NFKD library routine that
>       does such normalization.  This impacts step (2)(b) and possibly
>       also step (1)(a), and is an issue only with ill-formed UTF-8
>       input.

I'm thinking about just using Lucene's ICUFoldingFilterFactory for this.


