Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I've found lowering the temperature and disabling the repetition penalty can help [0]. My explanation is that the repetition penalty penalizes the end of sentences and sort of forces the generation to go on instead of stopping.

[0] https://old.reddit.com/r/LocalLLaMA/comments/17e855d/llamacp...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: