Website knowledge base
# 🤝help
f
I want to include a website and all the URLs within that website as a knowledge base. Two part question - does the knowledge base recursively find all the URLs under the home page URL? For example, for realestate.com when I add that into the KB does Botpress also learn from realestate.com/locations? Or do I have to add every single URL (there can be hundreds) manually? Second question - is there a character limit for the knowledge base when trained from a website URL? If so, what is the character limit? Entire Websites can contain millions of characters
f
first question yes, our website KB will find all nested urls.
no i dont believe there is a max, it will index the whole thing find the relevant page then chatgpt will do its magic to serve the relevant in natural language to match the querry
f
Hi @freezing-printer-49373 thanks for responding! Great to hear about the nested URLs. Would you be able to confirm whether there is a character limit or the "max"? I have KB that will be 2mil + or 3mil + characters for the website in total
f
Not to my knowledge
let me know if you face any issues