Several different websites of our customer, which are based on different CMS or store systems, are not indexed correctly. Only 1 page is recognized at a time. The systems have automatically generated sitemaps, once Botpress was able to index everything, but 99.9% of the time not, what is the problem?

@great-keyboard-52061 I ran into a similar situation -- is the site set to

noindex

or blocked in

robots.txt

? If it's set to

noindex

, only one page will be ingested at a time

@wonderful-wolf-37241 thanks for your reply, but no, unfortunately there is no

noindex

set or blocked in any way.