Search the web not working
# šŸ¤help
p
Hey Botpress folks, We’re a group of students working on a chatbot for our school’s website, and we happened to sumble upon botpress. The bot needs to pull info from different parts of the site, including static info pages and dynamic pages (which frequently update) with PDF circulars. We’ve added the static pages to the bot’s knowledge base as website resource using their URLs, since these will remain pretty much the same. But we’re having trouble with the dynamic pages. We’ve set up the URLs like this: {website}/index.php/circolare/page/{page_number}/ and we’re considering pages 1 to 26, as this provides a good balance between the volume of pages and the need to consider the most recent circulars. We tried adding these dynamic pages as ā€œsearch the webā€ resources because they update very frequently. But when we do that, the bot just loads forever and doesn’t give an answer. If we only include the static pages as website resources the bot is able to extract information from them and answer just fine.. Any advice on how we can get the bot to work with both static and dynamic pages? Thank you.