Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Tldr: 5% - 17% speedup due to removing a bottleneck by juggling where on a GPU/compute core a computation is done during Flash attention.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: