Website Scraper Information
# 🤝helpc
careful-kitchen-31087
03/20/2024, 5:47 AMQuestion - does the web scraper actually scrape the whole page or does it just scrape metadata? For some reason, it feels like the knowledge base I have with website data (which there are over 1,000 articles on) returns nothing valuable.
f
famous-jewelry-85388
03/20/2024, 5:06 PMHey @careful-kitchen-31087 ,
Can you drop me the link to the website?
famous-jewelry-85388
03/20/2024, 5:07 PMAlso you can use the "Search the Web" if your website is indexed by Bing
c
careful-kitchen-31087
03/20/2024, 5:43 PMhttps://help.gohighlevel.com/support/solutions/ it loads all 1000 pages but the knowledge content is title and meta only
f
famous-jewelry-85388
03/21/2024, 9:04 PMBut the bot starts from the root of the sitemap, can you see the links in the sitemap?