I am following and sharing your question, I am experimenting with exactly that , unecessary extra message ( in the conversation and costs ) and not sure if you had also a 2nd issue, when returning to the autonomous mode, it process the last messages and repeat the answers, again affecting the conversation and also spending more.