Hi all, New to the Botpress Discord. I'm building a Chatbot for a Hotel client and we're launching it next week. Today I discovered an issue where when the AI spend had reached its limit at $5, it no longer would answer the question. Previously, I could have sworn that even if it had hit the limit of $5, the chatbot would still query the knowledge base and successfuly answer the question of the user. Now it's just sending the error message that I have set up. I've tested increasing the AI spend limit and yes this did solve the issue. However I'm also finding that the chatbot is no longer answering questions that it could answer successfully a few days ago. I haven't made any major changes to the flow to cause this issue. I've also found that it's using much more AI Spend in $ than what it should be. Has anyone had this issue before with the chatbot not providing answers from the knowledge base when AI spend is at the limit. Unless I'm wrong but I'm very confident that the chatbot was providing answers even when it had hit the AI spend limit.

I haven't ever seen the bot answering from KB after reaching the spend limit. Perhaps in your case it was answering from cache? Im not sure. The increased AI spend could be because had you changed accounts and new account didnt have the cache or because u use hybrid or GPT-4 turbo instead of GPT-3.5 turbo which costs significantly more. Like 16x or something.

Got it, sorry just to confirm, in your experience you've never seen a Botpress chatbot query the KB without using any AI Spend?

It cannot query the KB without using AI spend. I think there's a problem right now, with it retrieving 50 chunks, instead of just 10, which is probably why, the AI spent has gone up

Makes sense! Is that a Botpress glitch / issue at the moment? I've read a few threads where people have mentioned this

I am not sure to be honest. I have asked the team about it, but it's the weekend, so they are not that active