If you have a lot of data, you will need to make sure your KB is super clear for the AI to crawl through. For example, it would be important to create separate sections for separate tasks (e.g. product info for 1 product, technical advice etc.) and name your documents with what they are about. In essence, creating multiple KBs for each purpose!
With my bot for example I always try to segment information as much as I can. Even to the extent of dividing documents for better chunking.
Hope it helps👍