Have you thought about the option to pick between different GPT's? In some use cases bard is better than ChatGPT 3.5 turbo since it has up to date info. Same for Claude. And also have you thought about other LLM's like gorilla or autogpt?