Knowledgebase URLs Empty
# 🤝help
b
Hi there, I'm attempting to set up a Knowledgebase for a website, but it always comes up empty. I've tried both an actual website (https://help.dropmap.net) and a sitemap (https://dropmap-help-sitemap.swervv.workers.dev/sitemap.xml) - but Botpress can't find any pages on it. https://cdn.discordapp.com/attachments/1227319958904635482/1227320095190159420/firefox_aS7qs7jQob.mp4?ex=6627f9e9&is=661584e9&hm=1626c75361f442283a19c209808912a5c0a7dd5778156466e2bb0d3a9d5e0183&
b
Hey! Thanks for the help, I think this should generally work, but I'd be concerned about new features releasing, but the associated helpdesk articles not yet being indexed by search engines. It's weird that it doesn't seem to be able to scrape the site itself, even with 2 different methods.
f
I just tested it, and it worked great for me 🙂
b
Hm, yeah, this seems to work - makes it even weirder that it can't detect them automatically though
Do you know if there's an official support channel anywhere where I could report this? I've only managed to find this Discord so far 🤔
f
Yup. Maybe this is something that someone like @famous-jewelry-85388 knows a bit more about than me? **Context**: amplitudes can't use his website in the "Website" source, because it can't find his pages. When entering the page manually works just fine. Using "Search The Web" as the souce, with just his domain works fine also.
This thread here #1111009377525186570 which we are in is the place for the free community support. If you are a paid member like on the Team plan you get Live-Chat support. You can also report it in the studio, and then include the Report ID here, but I don't think that is necessary for this.
@square-energy-41150
s
# Sending a Problem Report Here's how to send the Botpress Team a problem report: 1. In the Botpress Cloud Studio, locate the "Help" icon in the bottom left corner of the screen. 2. Click "Report a problem" and follow the steps on the screen. 3. Copy the Report ID to your clipboard and provide it to a member of the Botpress Team on Discord.
b
Alright, thank you very much for your help!
f
You are very welcome 🙂
r
@bland-soccer-68619 sorry about the confusion here, the domain of the sitemap has to be the same as the website(s) it references
for example, a sitemap hosted on
https://dropmap-help-sitemap.swervv.workers.dev/sitemap.xml
can only reference pages on the
workers.dev
url
In your case, the sitemap must be hosted on
help.dropmap.net
Actually, this limitation has been fixed by our team. They're deploying the fix now.
f
Amazing! Great work
r
@bland-soccer-68619 can you try again and confirm this works?
b
Hey! I’m not home at the moment but will test as soon as I am and let you know, I appreciate the quick reply :)
Seems to be working now, thank you!
Just one more thing, @rich-battery-69172 - is there a list of IP addresses botpress uses to fetch pages from? We have email protection as standard with Cloudflare, which breaks some responses.