1379 2002-10-08 23:24:04 +0400 GROUP value printed in Russian in other locales 2005-12-19 17:12:59 +0300 1 1 4 Development Sisyphus rpm unstable all Linux CLOSED FIXED P5 normal --- 1 vanyaz placeholder at glebfm imz ldv placeholder vt qa-sisyphus oldest_to_newest 1300 0 vanyaz 2002-10-08 23:24:04 +0400 I\'m testing how rpm prints localized values in mainly UTF-8 locales. The results differ between rpm-4.0.4-alt4 and rpm-4.0.4-alt7, but both are not correct. --- With rpm-4.0.4-alt7: $ LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации date demonstrates that genrally the specified locale is valid: $ LANG=de_AT.UTF-8 date -d \'Jan 6 2002\' Son Jц╓n 6 00:00:00 MSK 2002 With LANG=\'\', LANG=en and LANG=de rpm prints the English word (which I consider to be correct if there is no German translation available). With LANG=en_US, LANG=de_DE -- the Russian in KOI8-R (incorrect). rpm-4.0.4-alt4 is the same except for that it doesn\'t covert the output string to UTF-8 -- always KOI8-R. --- 4236 1 ldv 2002-10-09 18:20:03 +0400 It\'s because of algorithm implemented in rpm. lib/header.c:headerFindI18NString() checks environment variables in this order: LC_ALL, LC_MESSAGES, LANG. 7601 2 ldv 2002-10-09 18:20:03 +0400 It\'s because of algorithm implemented in rpm. lib/header.c:headerFindI18NString() checks environment variables in this order: LC_ALL, LC_MESSAGES, LANG. 4237 3 vanyaz 2002-10-09 20:30:07 +0400 What does it mean: \"checks environment variables in this order\": latter override former or vice versa? This still doen\'t explain why only changing LANG with the rest of the environment remaining the same we can get either English (with invalid (?) LANG=\'\', LANG=en and LANG=de) or Russian (LANG=de_AT.UTF-8) Group names: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 7602 4 vanyaz 2002-10-09 20:30:07 +0400 What does it mean: \"checks environment variables in this order\": latter override former or vice versa? This still doen\'t explain why only changing LANG with the rest of the environment remaining the same we can get either English (with invalid (?) LANG=\'\', LANG=en and LANG=de) or Russian (LANG=de_AT.UTF-8) Group names: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 4238 5 vanyaz 2002-10-09 20:35:22 +0400 Here are the corresponding locale values: LC_MESSAGES is unset, LC_ALL is empty (also unset). [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ locale LANG=ru_RU.KOI8-R LC_CTYPE=\"ru_RU.KOI8-R\" LC_NUMERIC=\"ru_RU.KOI8-R\" LC_TIME=\"ru_RU.KOI8-R\" LC_COLLATE=\"ru_RU.KOI8-R\" LC_MONETARY=\"ru_RU.KOI8-R\" LC_MESSAGES=\"ru_RU.KOI8-R\" LC_PAPER=\"ru_RU.KOI8-R\" LC_NAME=\"ru_RU.KOI8-R\" LC_ADDRESS=\"ru_RU.KOI8-R\" LC_TELEPHONE=\"ru_RU.KOI8-R\" LC_MEASUREMENT=\"ru_RU.KOI8-R\" LC_IDENTIFICATION=\"ru_RU.KOI8-R\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 locale LANG=de_AT.UTF-8 LC_CTYPE=\"de_AT.UTF-8\" LC_NUMERIC=\"de_AT.UTF-8\" LC_TIME=\"de_AT.UTF-8\" LC_COLLATE=\"de_AT.UTF-8\" LC_MONETARY=\"de_AT.UTF-8\" LC_MESSAGES=\"de_AT.UTF-8\" LC_PAPER=\"de_AT.UTF-8\" LC_NAME=\"de_AT.UTF-8\" LC_ADDRESS=\"de_AT.UTF-8\" LC_TELEPHONE=\"de_AT.UTF-8\" LC_MEASUREMENT=\"de_AT.UTF-8\" LC_IDENTIFICATION=\"de_AT.UTF-8\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de locale LANG=de LC_CTYPE=\"de\" LC_NUMERIC=\"de\" LC_TIME=\"de\" LC_COLLATE=\"de\" LC_MONETARY=\"de\" LC_MESSAGES=\"de\" LC_PAPER=\"de\" LC_NAME=\"de\" LC_ADDRESS=\"de\" LC_TELEPHONE=\"de\" LC_MEASUREMENT=\"de\" LC_IDENTIFICATION=\"de\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 7603 6 vanyaz 2002-10-09 20:35:22 +0400 Here are the corresponding locale values: LC_MESSAGES is unset, LC_ALL is empty (also unset). [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ locale LANG=ru_RU.KOI8-R LC_CTYPE=\"ru_RU.KOI8-R\" LC_NUMERIC=\"ru_RU.KOI8-R\" LC_TIME=\"ru_RU.KOI8-R\" LC_COLLATE=\"ru_RU.KOI8-R\" LC_MONETARY=\"ru_RU.KOI8-R\" LC_MESSAGES=\"ru_RU.KOI8-R\" LC_PAPER=\"ru_RU.KOI8-R\" LC_NAME=\"ru_RU.KOI8-R\" LC_ADDRESS=\"ru_RU.KOI8-R\" LC_TELEPHONE=\"ru_RU.KOI8-R\" LC_MEASUREMENT=\"ru_RU.KOI8-R\" LC_IDENTIFICATION=\"ru_RU.KOI8-R\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 locale LANG=de_AT.UTF-8 LC_CTYPE=\"de_AT.UTF-8\" LC_NUMERIC=\"de_AT.UTF-8\" LC_TIME=\"de_AT.UTF-8\" LC_COLLATE=\"de_AT.UTF-8\" LC_MONETARY=\"de_AT.UTF-8\" LC_MESSAGES=\"de_AT.UTF-8\" LC_PAPER=\"de_AT.UTF-8\" LC_NAME=\"de_AT.UTF-8\" LC_ADDRESS=\"de_AT.UTF-8\" LC_TELEPHONE=\"de_AT.UTF-8\" LC_MEASUREMENT=\"de_AT.UTF-8\" LC_IDENTIFICATION=\"de_AT.UTF-8\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de locale LANG=de LC_CTYPE=\"de\" LC_NUMERIC=\"de\" LC_TIME=\"de\" LC_COLLATE=\"de\" LC_MONETARY=\"de\" LC_MESSAGES=\"de\" LC_PAPER=\"de\" LC_NAME=\"de\" LC_ADDRESS=\"de\" LC_TELEPHONE=\"de\" LC_MEASUREMENT=\"de\" LC_IDENTIFICATION=\"de\" LC_ALL= [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 4239 7 vanyaz 2002-10-09 20:37:35 +0400 Several more strange examples: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de_AT.UTF-8 LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ echo $LANGUAGE ru_RU.KOI8-R [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 7604 8 vanyaz 2002-10-09 20:37:35 +0400 Several more strange examples: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de_AT.UTF-8 LANG=de_AT.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ echo $LANGUAGE ru_RU.KOI8-R [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ 4240 9 vanyaz 2002-10-09 20:46:15 +0400 If we assume that LANGUAGE is the variable that specifies the language of Group value (and neither LANG nor LC_*), then this test remains unexplained: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru_RU.KOI8-R LANG=invalid rpmquery -q minicom --qf=%{GROUP}\\\\n Communications 7605 10 vanyaz 2002-10-09 20:46:15 +0400 If we assume that LANGUAGE is the variable that specifies the language of Group value (and neither LANG nor LC_*), then this test remains unexplained: [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru_RU.KOI8-R LANG=invalid rpmquery -q minicom --qf=%{GROUP}\\\\n Communications 4241 11 ldv 2002-10-09 21:10:30 +0400 I\'ve planned to add LANGUAGE to the head of the variables list rpm uses in that algorithm. rpm-4.1 also checks LANGUAGE. (first nonempty variable from that list is used.) 7606 12 ldv 2002-10-09 21:10:30 +0400 I\'ve planned to add LANGUAGE to the head of the variables list rpm uses in that algorithm. rpm-4.1 also checks LANGUAGE. (first nonempty variable from that list is used.) 4242 13 vanyaz 2002-10-09 22:51:28 +0400 After reading the info page on \"Using gettextized software\", I think that 2 parallel list hav to be used by rpm for getting different information: (LANGUAGE, ) LC_ALL, LC_MESSAGES, LANG should be examined to get the language (perhaps, a short name like \"de\"), and LANGUAGE, LC_ALL, LC_CTYPE, LANG for the codeset to convert to. I\'m not sure whether LANGUAGE should be included in the second list. It seems that rpm does all this already (without LANGUAGE in the 2nd list): [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=en LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=de_DE.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=de rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=invalid rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru_RU.UTF-8 LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru_RU.UTF-8 LC_CTYPE=de_DE.ISO8859-1 rpmquery -q minicom --qf=%{GROUP}\\\\n ???????????? If LC_TYPE is invalid, it outputs the English value. I do not see any important misbahaviour. It seems it was my error to report this bug because I didn\'t understand how all the locale variables work together quiet well. This concerns GROUP. I see misbahaviour in recoding SUMMARY. They should be recoded just as the GROUPs are (and the error messages), I think. A testing script is attached. I run it twice: cat /user/imz/test_i18n_rpm_language.sh | sh cat /user/imz/test_i18n_rpm_language.sh | sed -e \'s!LANGUAGE!LC_MESSAGES!g\' | sh The results are different. 7607 14 vanyaz 2002-10-09 22:51:28 +0400 After reading the info page on \"Using gettextized software\", I think that 2 parallel list hav to be used by rpm for getting different information: (LANGUAGE, ) LC_ALL, LC_MESSAGES, LANG should be examined to get the language (perhaps, a short name like \"de\"), and LANGUAGE, LC_ALL, LC_CTYPE, LANG for the codeset to convert to. I\'m not sure whether LANGUAGE should be included in the second list. It seems that rpm does all this already (without LANGUAGE in the 2nd list): [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=en LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=de_DE.UTF-8 rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=de rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=ru LC_CTYPE=invalid rpmquery -q minicom --qf=%{GROUP}\\\\n | iconv -f utf-8 -t koi8-r Communications [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru_RU.UTF-8 LC_CTYPE=ru_RU.KOI8-R rpmquery -q minicom --qf=%{GROUP}\\\\n Коммуникации [<a href="mailto:imz@altair" target="_new">imz@altair</a> imz]$ LANGUAGE=de:ru_RU.UTF-8 LC_CTYPE=de_DE.ISO8859-1 rpmquery -q minicom --qf=%{GROUP}\\\\n ???????????? If LC_TYPE is invalid, it outputs the English value. I do not see any important misbahaviour. It seems it was my error to report this bug because I didn\'t understand how all the locale variables work together quiet well. This concerns GROUP. I see misbahaviour in recoding SUMMARY. They should be recoded just as the GROUPs are (and the error messages), I think. A testing script is attached. I run it twice: cat /user/imz/test_i18n_rpm_language.sh | sh cat /user/imz/test_i18n_rpm_language.sh | sed -e \'s!LANGUAGE!LC_MESSAGES!g\' | sh The results are different. 15659 15 ldv 2004-06-27 02:23:50 +0400 Fixed in rpm-4.0.4-alt39 121 2002-10-09 22:53:06 +0400 2002-10-09 22:53:06 +0400 0001379-test_i18n_rpm_language.sh 0001379-test_i18n_rpm_language.sh application/x-sh 522 vanyaz IyEvYmluL2Jhc2gKClFVRVJZPSgtcSBycG0gJy0tcWY9JXtHUk9VUH1cbiV7U1VNTUFSWX1cbicp Cgp0ZXN0KCkgewogICAgcnBtcXVlcnkgLXEgIiR7UVVFUllbQF19IgogICAgcnBtcXVlcnkgLXEg LS1xZj0le0VSUn0KfQoKdW5zZXQgTEFORycnVUFHRSBMQU5HIExDX01FU1NBR0VTIExDX0NUWVBF IExDX0FMTApleHBvcnQgTEFORycnVUFHRSBMQU5HIExDX01FU1NBR0VTIExDX0NUWVBFIExDX0FM TAoKTEFORz1lbl9VUwojZXhwb3J0IExBTkcKCiNleHBvcnQgTEFOR1VBR0UgTENfQ1RZUEUKCmVj aG8gIlVzaW5nIExBTkc9JExBTkcuLi4iCgpmb3IgTEFOR1VBR0UgaW4gcnUgZGUgcnVfUlUuS09J OC1yIHJ1X1JVLlVURi04OyBkbwogICAgZm9yIExDX0NUWVBFIGluIHJ1X1JVLktPSTgtUiBydV9S VS5VVEYtOCBkZV9ERS5JU084ODU5LTEgZGVfREUuVVRGLTggaW52YWxpZDsgZG8KCWVjaG8KCWVj aG8gIkxBTkdVQUdFPSRMQU5HVUFHRTsgTENfQ1RZUEU9JExDX0NUWVBFOiAiCgl0ZXN0CiAgICBk b25lCmRvbmUK