Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's not a "benefit", it's simply how the technology works - the underlying model just fundamentally works on tokens as it's atomic inputs.

The models don't know anything about words, just tokens.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: