I usually turn off the automatic answering of Knowledge Agent to have better control of when it replies. If you want to try that you can go to the knowledge agent in top left corner. Toggle on Manual Answering. Now you control when the message gets sent out. To send it, create a text card and then put in {{turn.KnowledgeAgent.answer}}