Hi there, I'm attempting to set up a Knowledgebase for a website, but it always comes up empty. I've tried both an actual website (https://help.dropmap.net) and a sitemap (https://dropmap-help-sitemap.swervv.workers.dev/sitemap.xml) - but Botpress can't find any pages on it. https://cdn.discordapp.com/attachments/1227319958904635482/1227320095190159420/firefox_aS7qs7jQob.mp4?ex=6627f9e9&is=661584e9&hm=1626c75361f442283a19c209808912a5c0a7dd5778156466e2bb0d3a9d5e0183&

Hey there, Have you tried using the "Search the web" as your source. This will take the whole website, and worked fine for me. Let me know if this solution doesn't work for you. https://cdn.discordapp.com/attachments/1227319958904635482/1227335330328477696/image.png?ex=66280819&is=66159319&hm=80219cde3ba1216dd1ccbe08eff23fea01627947c32c6471ce48908d9ffe7134& https://cdn.discordapp.com/attachments/1227319958904635482/1227335330647113801/image.png?ex=66280819&is=66159319&hm=9a75b1e8f8e96257786a01a17b7bf7987263abfbc8360dfaeb309ad763328ddf&

Hey! Thanks for the help, I think this should generally work, but I'd be concerned about new features releasing, but the associated helpdesk articles not yet being indexed by search engines. It's weird that it doesn't seem to be able to scrape the site itself, even with 2 different methods.

You are very welcome, and it is a bit weird. Have you tried to manually enter some of the pages? https://cdn.discordapp.com/attachments/1227319958904635482/1227337305870831716/image.png?ex=662809f0&is=661594f0&hm=e57a4f338b92ab19f2d752e5a36af31e32ab8ce3ff23e86f3cc8da5512504f69&

Hm, yeah, this seems to work - makes it even weirder that it can't detect them automatically though

Yup. Maybe this is something that someone like @famous-jewelry-85388 knows a bit more about than me? **Context**: amplitudes can't use his website in the "Website" source, because it can't find his pages. When entering the page manually works just fine. Using "Search The Web" as the souce, with just his domain works fine also.

# Sending a Problem Report Here's how to send the Botpress Team a problem report: 1. In the Botpress Cloud Studio, locate the "Help" icon in the bottom left corner of the screen. 2. Click "Report a problem" and follow the steps on the screen. 3. Copy the Report ID to your clipboard and provide it to a member of the Botpress Team on Discord.

Alright, thank you very much for your help!

You are very welcome 🙂

@bland-soccer-68619 sorry about the confusion here, the domain of the sitemap has to be the same as the website(s) it references

Amazing! Great work

@bland-soccer-68619 can you try again and confirm this works?

Hey! I’m not home at the moment but will test as soon as I am and let you know, I appreciate the quick reply :)

Hey! Is there an exhaustive list of botpress IP adresses? I need to whitelist them in one of the external APIs that I use