From: Tom Lane Date: Wed, 11 Jun 2014 02:48:16 +0000 (-0400) Subject: Fix ancient encoding error in hungarian.stop. X-Git-Tag: REL9_2_9~28 X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=802323535788965f041b4fdaecc16025f289cb44;p=postgresql Fix ancient encoding error in hungarian.stop. When we grabbed this file off the Snowball project's website, we mistakenly supposed that it was in LATIN1 encoding, but evidently it was actually in LATIN2. This resulted in ő (o-double-acute, U+0151, which is code 0xF5 in LATIN2) being misconverted into õ (o-tilde, U+00F5), as complained of in bug #10589 from Zoltán Sörös. We'd have messed up u-double-acute too, but there aren't any of those in the file. Other characters used in the file have the same codes in LATIN1 and LATIN2, which no doubt helped hide the problem for so long. The error is not only ours: the Snowball project also was confused about which encoding is required for Hungarian. But dealing with that will require source-code changes that I'm not at all sure we'll wish to back-patch. Fixing the stopword file seems reasonably safe to back-patch however. --- diff --git a/src/backend/snowball/stopwords/hungarian.stop b/src/backend/snowball/stopwords/hungarian.stop index 94e9f9a0b0..abfd35ce97 100644 --- a/src/backend/snowball/stopwords/hungarian.stop +++ b/src/backend/snowball/stopwords/hungarian.stop @@ -55,10 +55,10 @@ ekkor el elég ellen -elõ -elõször -elõtt -elsõ +elő +először +előtt +első én éppen ebben @@ -149,9 +149,9 @@ nincs olyan ott össze -õ -õk -õket +ő +ők +őket pedig persze rá