I would like to see an option in the bot settings (and the kb agent) to define a fallback LLM for both the Default Fast and Default Best LLM configurations. If the primary LLM encounters a timeout or connectivity issue, the bot could automatically switch to the designated fallback LLM. For example, the Fast LLM might be set to GPT 4o mini with Claude Sonnet as a fallback, while the Best LLM could be set to Claude Sonnet with GPT 4o mini as a fallback. This approach could significantly reduce downtime and errors. https://cdn.discordapp.com/attachments/1317119394928922654/1317119395209809981/0e0879f59b4d417e9324.png?ex=675d8686&is=675c3506&hm=b94c876b77dbd7a0b2550e533f11597edd476c9c0912a58e8f28e41bcf1bb7c6&

Hi, this is in the works. You can expect it soon.

I have seen that Fallback LLM is installed. Top! If that were still working for the KB now, that would be gigantic.