Knowledge web pages stop at a certain point
# 🤝helpc
curved-tent-11147
08/22/2023, 7:12 AMHi, I've added a site map and also webpages manually for indexation, for each of them, the indexation stop at a certain point in the page so the bot can't get all the information about it, any idea ? (I'm not at my full storage quota)
Thank you !
a
acceptable-kangaroo-64719
08/22/2023, 10:55 AMHey @curved-tent-11147 are you saying that onle certain pages are getting ingested, or only certain parts of each page are getting ingested?
c
curved-tent-11147
08/22/2023, 12:04 PMOnly certain parts of each page (the beginning)
a
acceptable-kangaroo-64719
08/23/2023, 10:33 AMinteresting! Is this content loaded in an iFrame or anything funky like that? And would you mind sharing the website so I can try replicating it on my end?
c
curved-tent-11147
08/23/2023, 12:47 PMSure, thank you for your help & your time 🙏 !
curved-tent-11147
08/23/2023, 12:47 PMhere the website : https://studio.camsyoga.fr/programs/confort-dans-nos-epaules
a
acceptable-kangaroo-64719
08/25/2023, 11:46 AMWhen I gave this a try I was not able to see the video title or description in the scraped chunks. Is this what you're talking about?
c
curved-tent-11147
08/26/2023, 9:35 AMI'm looking for the description
a
acceptable-kangaroo-64719
08/28/2023, 10:34 AMYeah it looks like the descriptions are kept in an iframe that our webpage scraper isn't getting to. Does it work if you're using a web search instead of a web page source?
c
curved-tent-11147
08/28/2023, 1:56 PMHow do I know it works with Web Page Source ? (i think it doesn't because I do not get the right answer)
https://cdn.discordapp.com/attachments/1143442436266414141/1145718503777767454/Capture_decran_2023-08-28_a_15.51.29.png▾
a
acceptable-kangaroo-64719
08/28/2023, 2:03 PM> i think it doesn't because I do not get the right answer
That's how you know if it works or not. So I guess it doesn't work then
acceptable-kangaroo-64719
08/28/2023, 2:04 PMis that info anywhere else on the website that you could scrape from?
c
curved-tent-11147
08/28/2023, 2:23 PMunfortunately non...
a
acceptable-kangaroo-64719
08/28/2023, 3:21 PM@acceptable-gold-88171 do you have any ideas?
a
acceptable-gold-88171
08/28/2023, 4:01 PMI created an issue internally, this looks liek a problem on our end, in the mean time, if you don't have many pages, you can save them as pdf and upload them.
c
curved-tent-11147
08/29/2023, 5:45 PMDo you have a roadmap for that ? I have a like 100 pages to manually import...
curved-tent-11147
08/29/2023, 5:45 PMThank you !
2 Views