Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> To have vector of characters (as what humans consider characters) is valuable.

That might be an awful can of worms. Are Arabic vowels characters? "ij" letter in Dutch? Would you separate Korean text into letters or treat each block of letters as a character?



I can answer the question on Korean. Treat each block of letters as a character. Never ever separate for human uses.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: