In this context by "real time" people usually mean "as fast as I can read the re... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kouteiheika 29 days ago \| parent \| context \| favorite \| on: A 30B Qwen model walks into a Raspberry Pi and run... In this context by "real time" people usually mean "as fast as I can read the reply", so, 0.0002 tokens per minute would not be considered "real time".

rurban 29 days ago [–]

Real time typically means guaranteed reaction time below 30ms, because slower reactions will make the body through up.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact