Long delay between messaging bot and response - ho...
# 🤝helpf
fancy-breakfast-34453
08/01/2023, 9:04 PMI've been testing my bot on my staging site and there's a big delay between sending an initial messaging and getting a response - is tehre a way t speed this up? It's to the point that I've thought it was broken multiple times while testing
Thanks!
f
famous-zoo-73118
08/01/2023, 9:56 PMHi Becca, is your chatbot using multiple agents such as Personality, Translation, Summary?
f
fancy-breakfast-34453
08/01/2023, 10:07 PMHi! I don't believe so
fancy-breakfast-34453
08/01/2023, 10:07 PMlink in case helpful! https://studio.botpress.cloud/3b1f8bf2-816c-4288-a215-9c1cc2bb090e/flows/wf-main
f
famous-zoo-73118
08/01/2023, 10:27 PMWhat kind of delays are you seeing? A couple of seconds is normal as the chatbots run on-demand so sometimes they take a bit to warm up initially and also there's additional time involved in serving AI or knowledge base tasks which use GPT under the hood.
famous-zoo-73118
08/01/2023, 10:28 PMSo usually messages for a typical bot would be processed in a few secs up to 10 secs tops for really heavy replies involving KB, AI, or agents.
f
fancy-breakfast-34453
08/01/2023, 10:36 PMI'm seeing 10secs plus and this isn't complex
fancy-breakfast-34453
08/01/2023, 10:36 PMwhich is why I wanted to reach out
fancy-breakfast-34453
08/01/2023, 11:02 PManything I can modify in the bot to speed things up?
fancy-breakfast-34453
08/02/2023, 4:22 PMgood morning - checking in here!
f
famous-zoo-73118
08/02/2023, 4:58 PMCan you add us to your workspace with the Developer role using our account sherlock@botpress.com and let me know the name of your bot so I can do some tests and check how your bot looks? You can do so by clicking on the gear icon on the top right corner of the BP Cloud dashboard and then clicking on "Collaborators".
f
fancy-breakfast-34453
08/02/2023, 6:59 PMwill do thanks!
fancy-breakfast-34453
08/02/2023, 7:00 PMdone and it's called "puzzled-clam"
fancy-breakfast-34453
08/02/2023, 7:00 PMthanks for taking a look
f
famous-zoo-73118
08/02/2023, 8:02 PMThanks 🙂 I did a quick test and the bot seems to be replying quickly in general, so I suspect the issue might be with a specific node. Could you send me a screenshot of the point in the conversation with the bot where you're noticing the delay so I can replicate the issue?
f
fancy-breakfast-34453
08/02/2023, 11:09 PMit's the very beginning when I send the first message to say hi
fancy-breakfast-34453
08/02/2023, 11:09 PMthanks for looking - appreciate it!
f
famous-zoo-73118
08/03/2023, 12:59 AMHappy to help! I recorded a quick video of how it looks on my end and it took 11 seconds on the first message and then the bot responds quickly afterwards: https://www.loom.com/share/3cff5de052cc4e03a460a1315456547b?sid=c5208c7d-0e45-443c-b86c-fd0780c2be05
famous-zoo-73118
08/03/2023, 1:00 AMThen I cleared the conversation and started over, and the first message was responded by the bot in a little over 1 second: https://www.loom.com/share/6f0d435bf3a64f6480290989d8840b89?sid=2270be99-2fb8-4d3e-91db-f9effa99d17f
famous-zoo-73118
08/03/2023, 1:02 AMSo, this seems to be the normal warm-up behavior of the bots when they haven't been used for a little while so they go into sleep mode, as they run on-demand which allows us to price them in a pay-as-you-go fashion 🙂
famous-zoo-73118
08/03/2023, 1:03 AMWhen the bot is in production and used by people regularly on the website then this shouldn't happen very often, as the bot will be up and running as long as it's used frequently enough, so hopefully it won't be a worry!
famous-zoo-73118
08/03/2023, 1:12 AMAlso, it's in our roadmap to add some better UI feedback to the user so when this happens at least it appears that the bot is working to reply back to the user.
l
little-scientist-91622
08/07/2023, 3:28 PMI'm facing this today. About 10 sec delays between responses and many occasions it didn't respond.
Additional info: I realised that only my mobile is suffering from this. Laptops are fine.
f
fancy-breakfast-34453
08/08/2023, 10:26 PMThanks @famous-zoo-73118 ! Helpful context - having more feedback to the user would be good as now it just looks like it's not working and 11 seconds is a long time to wait
fancy-breakfast-34453
08/08/2023, 10:26 PM+1 to your roadmap item!