Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I guess only if you consider punctuation to be "words". A more accurate description would be "lexers work at the atom level", IOW breaking the input into atoms - the smallest non-breakable lexical units that are used in a grammar.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: