Knowledge Base doesn't find all pages of my websit...
# 🤝help
s
In the knowledge base, I cannot integrate my website so that all the pages of the website are indexed. So that the chatbot can fetch the information it needs from my website to answer users' questions.
c
Hello! So the bot is only finding the main page? Try making the sitemap available at https://www.YOURWEBSITE/sitemap.xml, so that the bot can crawl it.
s
I didn't succeed, what should I do?
c
The other option would be to save the information in document and then upload the document to your KB.
s
@crooked-van-25152 yes but more longer because we have a lot of information and document
c
easiest way is trying to make the sitemap available!
then, the bot can crawl all pages
s
how can i do it ? what are the steps to make the sitemab available ? Thank you !!!
c
This isn't something that can be done within Botpress. Google and YouTube will be your best friends here 🙂
e
You can also leverage ChatGPT or Bing Chat to guide you to create a sitemap for whatever architecture you have
s
yes thank you for your answer !
@early-train-33247 @crooked-van-25152 I have a sitemap but when I enter it in the KB, it detect only 1 page
c
Maybe it has to do with the way your sitemap was set up (someone else was facing the same issue yesterday). Try switching from "a website" to "specific web pages", then just paste your list of urls, it will put each one in a separate input.
Let me know if that fixed the issue!
s
so i have to put each pages of my website ?
c
Url should be : www.YOURWEBSITE.sitemap.xml so that the bot can crawl it.
f
For me it helped to put in
https://www.mysite.com/sitemap.xml
into the field instead of
mysite.com
- though this should ideally be supported as well.