Ask it a series of the same questions after you train that you posed before trai... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		RALaBarge 6 months ago \| parent \| context \| favorite \| on: My 2.5 year old laptop can write Space Invaders in... Ask it a series of the same questions after you train that you posed before training started. Is the quality lower?

israrkhan 6 months ago [–]

That series of questions will measure only a particular area. I am concerned about destorying model capabilities in some other area that that I do not pay attention to, and have no way of knowing.

simonh 6 months ago | [–]

Isn’t that a general problem with LLMs? The only way to know how good it is at something is to test it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact