Set website crawl frequency?
# 🤝help
l
Is it possible to re-crawl a website to refresh the KB on a weekly/daily basis? I have a client who is constantly writing new content & pages for his website. It would be great to be able to have the KB updated with any updates & new pages without having to go in and manually re-index the whole website. I can't see any options for this in BP Studio, nor any feature requests here on Discord. Does anyone know if this is possible? Or does it happen already by default & I've just not noticed? Thanks in advance!
f
Hey, If you use "Website" as the KB source, you will have to index it manually to update it. If you use "Search The Web" as the KB source, it will update, when ever the search engine (probably Bing), indexes the page again, which depends on how much trafic the website has.
l
Hi @fresh-fireman-491 , thanks as always for the swift reply! Ok that's a bit disappointing. I'll add this to feature requests and hope it gets enough traction to be added in future.
f
You are very welcome, always a pleasure helping you! Please do that as this is something that could benefit most users.
l
2 Views