Great concept! Have had to build some bare bones solutions to handle LLM routing but no reason I needed to roll my own. Planning to give this a go next time I run into that issue.
Are you thinking about integrating smarter cost monitoring and reporting into routing as well?
Are you thinking about integrating smarter cost monitoring and reporting into routing as well?