There's a number of standard APIs already, OpenAI supports Anthopic's MCP, LM studio supports both their proprietary API as well as OpenAI's API. OpenAI has open sourced their realtime API (https://github.com/openai/openai-realtime-console/tree/webso...) and others. Most local clients just have a https://URL:port and then a drop down box for which RESTful API you want to use (for 88% of use cases they all support the same stuff, for realtime it's not quite settled yet), plus a field for an API key if needed.