Sometimes the bot will reply correctly, using the context of the conversation to ask a follow up question. Other times it simply spits out the conversation summary. Has anyone else experienced this and how to fix?

When would this happen? When it is answering from the KB?