https://discord.gg/botpress logo
Join DiscordCommunities
Powered by
Does knowledge base bot consume AI credits?
# 🤝help
i
My consumption has increased a lot over the past month, and before I didn't pay anything. Now, I'm paying several dollars a month due to AI consumption.
f
Hey there, Querying the KB does use AI Credits since an LLM is involved in the task.
Can you see any changed in the usage?
i
f
That looks a bit weird, but maybe you switched the model in the settings of the knowledge agent? Or added more AI heavy cards to your flow?
i
Knowledge bot settings were default. Today, I changed to GPT4o
My cards are very simple. Look
f
Doesn't look that bad. GPT-4o is half the price of GPT-4 so it should get cheaper 🙂
i
😦
f
That is weird. Maybe you can try and lower the amount of chunks retrieved from the KB. You can do that in the settings of the knowledge agent. Also, just as a test, can you query the KB via the emulator and then take a screenshot of the AI Usage from the logs.
i
Is this chunks option recent? because I don't remember that.
f
i
i'll try that
This was a frequently asked answer.
f
Thank you! Can you see how many chunks it used? Should be a bit above that
i
where?
54 results?
f
Yea, I expected something like that. Turning down the amount of chunks retrieved will help.
5 Views
PreviousNext
Powered by