UTF-8 Environment for Ubuntu Server

echo "en_US.UTF-8 UTF-8" > /var/lib/locales/supported.d/local
locale-gen
update-locale LANG=en_US.UTF-8

Note: For some VPS the last command does not work, you have to add this to ~/.bashrc or /etc/bash.bashrc too:

export LANG=en_US.UTF-8

Pinyin Sorting for non-Chinese Locales

Arch:

echo "LC_COLLATE=zh_CN.utf8" >> /etc/locale.conf

Ubuntu:

echo "LC_COLLATE=zh_CN.utf8" >> /etc/default/locale