https://discord.gg/botpress logo
Botpress with 5k Blogs Knowledge Base
# 🤝help
v
Hey i have a question my client have 5k blogs in his website and he wants to add them inside KB. Any recommendations so AI don't overloaded with so much data... I know Voiceflow got confused but how can we tackle this much data?
Also How much budget he should have budget.
@User
c
hey Hammad , pleasure to meet you. Can you provide some more information about the content of the blogs and where / what form it is hosted ? You might be able to connect to the back-end automatically using a e.g.
GET /v1/admin/knowledgebases
endpoint. I haven't had the time to play around with this myself so I encourage you to try it out and report back in case you need help.
f
Hey there, You can set the amount of chunks the knowledge agent should retrieve in the knowledge agent settings. Less chunks = less information
v
So here are the blogs
Client said 2k blogs are new might be doing 1k in knowledge base
What the budget he should need monthly basis based on gpt4o
@cold-jewelry-54343
@fresh-fireman-491
c
that is something you can calculate by looking at the KB size needed ("average blog size" x total blogs +=) + AI spend per single usage of your bot (the "Usage" tab is useful for that). Keep in mind that Gpt4o is quite expensive (especially compared to other models). **tip**: To keep costs down you could use certain techniques like "few-shot prompting" (prompt engineering technique with examples) that can actually outperform Gpt3.5 severely reducing costs.
m
@victorious-dress-99881 small work around may be to use website search, and give it the blog domain handle, and it can search each time