Yup, and you can fine-tune an LLM to be a specialized classifier with relatively little data compared to building a classifier from scratch. I think that's the biggest benefit to LLMs, the data required to show it a behavior is pretty minuscule in the scheme of things.