Knowledge web pages stop at a certain point
# 🤝help
c
Hi, I've added a site map and also webpages manually for indexation, for each of them, the indexation stop at a certain point in the page so the bot can't get all the information about it, any idea ? (I'm not at my full storage quota) Thank you !
a
Hey @curved-tent-11147 are you saying that onle certain pages are getting ingested, or only certain parts of each page are getting ingested?
c
Only certain parts of each page (the beginning)
a
interesting! Is this content loaded in an iFrame or anything funky like that? And would you mind sharing the website so I can try replicating it on my end?
c
Sure, thank you for your help & your time 🙏 !
a
When I gave this a try I was not able to see the video title or description in the scraped chunks. Is this what you're talking about?
c
I'm looking for the description
a
Yeah it looks like the descriptions are kept in an iframe that our webpage scraper isn't getting to. Does it work if you're using a web search instead of a web page source?
c
How do I know it works with Web Page Source ? (i think it doesn't because I do not get the right answer)

https://cdn.discordapp.com/attachments/1143442436266414141/1145718503777767454/Capture_decran_2023-08-28_a_15.51.29.png

a
> i think it doesn't because I do not get the right answer That's how you know if it works or not. So I guess it doesn't work then
is that info anywhere else on the website that you could scrape from?
c
unfortunately non...
a
@acceptable-gold-88171 do you have any ideas?
a
I created an issue internally, this looks liek a problem on our end, in the mean time, if you don't have many pages, you can save them as pdf and upload them.
c
Do you have a roadmap for that ? I have a like 100 pages to manually import...
Thank you !