Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Specifically for multi-choice string enums (essentially dropdowns), I wonder if this would work better if the full (joint/product) probability given the logits is considered when picking the final choice, rather than using a greedy algorithm. This will favor the right choice, as opposed to e.g. one of the choices that contain the most common start token - if a start token are shared among many items in the list.

Of course the probability needs to be adjusted once a subset of the logits goes to zero so it actually makes sense...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: