Unicode string normalization in C/C++

c++ unicode utf-8 utf-16 unicode-normalization
Ghassen Hamrouni picture Ghassen Hamrouni · Feb 3, 2011 · Viewed 10.9k times · Source

Am wondering how to normalize strings (containing utf-8/utf-16) in C/C++. In .NET there is a function String.Normalize .

I used UTF8-CPP in the past but it does not provide such a function. ICU and Qt provide string normalization but I prefer lightweight solutions.

Is there any "lightweight" solution for this?

Answer

Avi picture Avi · Feb 3, 2011

As I wrote in another question, utf8proc is a very nice, lightweight, library for basic Unicode functionality, including Unicode string normalization.

Related questions

Confused about C++'s std::wstring, UTF-16, UTF-8 and displaying strings in a windows GUI

I'm working on a english only C++ program for Windows where we were told "always use std::wstring", but it seems like nobody on the team really has much of an understanding beyond that. I already read the question titled "…

Read More
UTF8 to/from wide char conversion in STL

Is it possible to convert UTF8 string in a std::string to std::wstring and vice versa in a platform independent manner? In a Windows application I would use MultiByteToWideChar and WideCharToMultiByte. However, the code is compiled for multiple OSes …

Read More
Read Unicode UTF-8 file into wstring

How can I read a Unicode (UTF-8) file into wstring(s) on the Windows platform?

Read More