KCML_Normalize_UTF8

Purpose

Normalizes wide ASCII and half-width kana characters in a UTF8 string

Definition

DEFSUB 'KCML_Normalize_UTF8(BYREF utf8string$) AS Bool

Parameters

utf8string

UTF8 string

Return

Returns TRUE if string contained normalized characters.

Description

Modify string in place replacing any wide ASCII (in the range U+FF00-U+FF5E and ideographic space U+3000) characters with their narrow equivalent and any half-width kana characters (in the range U+FF61-U+FF9f) with their full-width equivalent. Where a character is followed by a dakuten (U+FF9E) or handakuten (U+FF9F) voice mark and the converted character incorporates the voice mark then the trailing mark character will be removed.

Conversions

Unicode	Character	Normalized Unicode	Normalized Character
U+FF01	！	U+0021	!
U+FF02	＂	U+0022	"
U+FF03	＃	U+0023	#
U+FF04	＄	U+0024	$
U+FF05	％	U+0025	%
U+FF06	＆	U+0026	&
U+FF07	＇	U+0027	'
U+FF08	（	U+0028	(
U+FF09	）	U+0029	)
U+FF0A	＊	U+002A	*
U+FF0B	＋	U+002B	+
U+FF0C	，	U+002C	,
U+FF0D	－	U+002D	-
U+FF0E	．	U+002E	.
U+FF0F	／	U+002F	/
U+FF10	０	U+0030	0
U+FF11	１	U+0031	1
U+FF12	２	U+0032	2
U+FF13	３	U+0033	3
U+FF14	４	U+0034	4
U+FF15	５	U+0035	5
U+FF16	６	U+0036	6
U+FF17	７	U+0037	7
U+FF18	８	U+0038	8
U+FF19	９	U+0039	9
U+FF1A	：	U+003A	:
U+FF1B	；	U+003B	;
U+FF1C	＜	U+003C	<
U+FF1D	＝	U+003D	=
U+FF1E	＞	U+003E	>
U+FF1F	？	U+003F	?
U+FF21	Ａ	U+0041	A
U+FF22	Ｂ	U+0042	B
U+FF23	Ｃ	U+0043	C
U+FF24	Ｄ	U+0044	D
U+FF25	Ｅ	U+0045	E
U+FF26	Ｆ	U+0046	F
U+FF27	Ｇ	U+0047	G
U+FF28	Ｈ	U+0048	H
U+FF29	Ｉ	U+0049	I
U+FF2A	Ｊ	U+004A	J
U+FF2B	Ｋ	U+004B	K
U+FF2C	Ｌ	U+004C	L
U+FF2D	Ｍ	U+004D	M
U+FF2E	Ｎ	U+004E	N
U+FF2F	Ｏ	U+004F	O
U+FF30	Ｐ	U+0050	P
U+FF31	Ｑ	U+0051	Q
U+FF32	Ｒ	U+0052	R
U+FF33	Ｓ	U+0053	S
U+FF34	Ｔ	U+0054	T
U+FF35	Ｕ	U+0055	U
U+FF36	Ｖ	U+0056	V
U+FF37	Ｗ	U+0057	W
U+FF38	Ｘ	U+0058	X
U+FF39	Ｙ	U+0059	Y
U+FF3A	Ｚ	U+005A	Z
U+FF3B	［	U+005B	[
U+FF3C	＼	U+005C	\
U+FF3D	］	U+005D	]
U+FF3E	＾	U+005E	^
U+FF3F	＿	U+005F	_
U+FF40	｀	U+0060	`
U+FF41	ａ	U+0061	a
U+FF42	ｂ	U+0062	b
U+FF43	ｃ	U+0063	c
U+FF44	ｄ	U+0064	d
U+FF45	ｅ	U+0065	e
U+FF46	ｆ	U+0066	f
U+FF47	ｇ	U+0067	g
U+FF48	ｈ	U+0068	h
U+FF49	ｉ	U+0069	i
U+FF4A	ｊ	U+006A	j
U+FF4B	ｋ	U+006B	k
U+FF4C	ｌ	U+006C	l
U+FF4D	ｍ	U+006D	m
U+FF4E	ｎ	U+006E	n
U+FF4F	ｏ	U+006F	o
U+FF50	ｐ	U+0070	p
U+FF51	ｑ	U+0071	q
U+FF52	ｒ	U+0072	r
U+FF53	ｓ	U+0073	s
U+FF54	ｔ	U+0074	t
U+FF55	ｕ	U+0075	u
U+FF56	ｖ	U+0076	v
U+FF57	ｗ	U+0077	w
U+FF58	ｘ	U+0078	x
U+FF59	ｙ	U+0079	y
U+FF5A	ｚ	U+007A	z
U+FF5B	｛	U+007B	{
U+FF5C	｜	U+007C	\|
U+FF5D	｝	U+007D	}
U+FF5E	～	U+007E	~
U+FF5F	｟	U+FF5F	｟
U+FF60	｠	U+FF60	｠
U+FF61	｡	U+30 2	。
U+FF62	｢	U+30 C	「
U+FF63	｣	U+30 D	」
U+FF64	､	U+30 1	、
U+FF65	･	U+30FB	・
U+FF66	ｦ	U+30F2	ヲ
U+FF67	ｧ	U+30A1	ァ
U+FF68	ｨ	U+30A3	ィ
U+FF69	ｩ	U+30A5	ゥ
U+FF6A	ｪ	U+30A7	ェ
U+FF6B	ｫ	U+30A9	ォ
U+FF6C	ｬ	U+30E3	ャ
U+FF6D	ｭ	U+30E5	ュ
U+FF6E	ｮ	U+30E7	ョ
U+FF6F	ｯ	U+30C3	ッ
U+FF70	ｰ	U+30FC	ー
U+FF71	ｱ	U+30A2	ア
U+FF72	ｲ	U+30A4	イ
U+FF73	ｳ	U+30A6	ウ
U+FF74	ｴ	U+30A8	エ
U+FF75	ｵ	U+30AA	オ
U+FF76	ｶ	U+30AB	カ
U+FF77	ｷ	U+30AD	キ
U+FF78	ｸ	U+30AF	ク
U+FF79	ｹ	U+30B1	ケ
U+FF7A	ｺ	U+30B3	コ
U+FF7B	ｻ	U+30B5	サ
U+FF7C	ｼ	U+30B7	シ
U+FF7D	ｽ	U+30B9	ス
U+FF7E	ｾ	U+30BB	セ
U+FF7F	ｿ	U+30BD	ソ
U+FF80	ﾀ	U+30BF	タ
U+FF81	ﾁ	U+30C1	チ
U+FF82	ﾂ	U+30C4	ツ
U+FF83	ﾃ	U+30C6	テ
U+FF84	ﾄ	U+30C8	ト
U+FF85	ﾅ	U+30CA	ナ
U+FF86	ﾆ	U+30CB	ニ
U+FF87	ﾇ	U+30CC	ヌ
U+FF88	ﾈ	U+30CD	ネ
U+FF89	ﾉ	U+30CE	ノ
U+FF8A	ﾊ	U+30CF	ハ
U+FF8B	ﾋ	U+30D2	ヒ
U+FF8C	ﾌ	U+30D5	フ
U+FF8D	ﾍ	U+30D8	ヘ
U+FF8E	ﾎ	U+30DB	ホ
U+FF8F	ﾏ	U+30DE	マ
U+FF90	ﾐ	U+30DF	ミ
U+FF91	ﾑ	U+30E0	ム
U+FF92	ﾒ	U+30E1	メ
U+FF93	ﾓ	U+30E2	モ
U+FF94	ﾔ	U+30E4	ヤ
U+FF95	ﾕ	U+30E6	ユ
U+FF96	ﾖ	U+30E8	ヨ
U+FF97	ﾗ	U+30E9	ラ
U+FF98	ﾘ	U+30EA	リ
U+FF99	ﾙ	U+30EB	ル
U+FF9A	ﾚ	U+30EC	レ
U+FF9B	ﾛ	U+30ED	ロ
U+FF9C	ﾜ	U+30EF	ワ
U+FF9D	ﾝ	U+30F3	ン
U+FF9E	ﾞ	U+3099	゙
U+FF9F	ﾟ	U+309A	゚
U+FF73 U+FF9E	ｳﾞ	U+30F4	ヴ
U+FF8A U+FF9E	ﾊﾞ	U+30D0	バ
U+FF8B U+FF9E	ﾋﾞ	U+30D3	ビ
U+FF8C U+FF9E	ﾌﾞ	U+30D6	ブ
U+FF8D U+FF9E	ﾍﾞ	U+30D9	ベ
U+FF8E U+FF9E	ﾎﾞ	U+30DC	ボ
U+FF8A U+FF9F	ﾊﾟ	U+30D1	パ
U+FF8B U+FF9F	ﾋﾟ	U+30D4	ピ
U+FF8C U+FF9F	ﾌﾟ	U+30D7	プ
U+FF8D U+FF9F	ﾍﾟ	U+30DA	ペ
U+FF8E U+FF9F	ﾎﾟ	U+30DD	ポ
U+FF78 U+FF9E	ｸﾞ	U+30AF	グ