https://discord.gg/botpress logo
Join Discord
Powered by
Time lag with OpenAI Assistant
# 🤝help
g
I've been using Botpress to host a OAI Assistant chatbot on my website. This may not be a solvable issue from Botpress' end, but the Assistant is triggered when a user starts the conversation, and the lag until the bot responds to that initial message can take 10-15 seconds. I lose a lot of people at that step. Is there anything I could do to reduce that latency? https://mediafiles.botpress.cloud/9571d09c-f02d-4693-9d69-f59d63f69e8a/webchat/bot.html
b
in order to reduce the amount Botpress costs (for our users), we don't keep instances alive across sessions (i.e. the bot)
however, to keep a bot alive, we offer a service called "Always Alive" that will ensure that first message sent to and from your bot doesn't need to wait for a new instance, which reduces the time to response on that first message
this costs 5$/month per bot 🙂
g
Oh nice! I'll take a look at that. Sorry for the slow reply, I hadn't seen that you responded. Thanks.
b
no worries - I could've tagged you haha
g
@User Just so I'm clear, the free plan doesn't come with any bots with Always Alive, correct? I was a little confused by the add-on description here. https://cdn.discordapp.com/attachments/1240100619193290852/1247992244527693986/image.png?ex=66620ad9&is=6660b959&hm=e19fac4fce78626d723e18f1be556d746f6ecc5cf1f7626cfad5a68b31d6a3a7&
b
yeah it doesn't come with any
it's written that way because the Team plan comes with some built in, so we'd like to avoid confusion
g
b
click the little bot menu on the bot you'd like it on!
g
Great thanks! I assume it'll take a little while to kick in. Just turned it on for my bot and on first try it took about 10 secs to respond.
Also, I'm a little confused, because I only turned Always On for one bot a few minutes ago, and I already got this alert saying I've reached my limit. Don't know if that means whether I'm capped at where I'm at (which is fine) or if the service isn't on at all. https://cdn.discordapp.com/attachments/1240100619193290852/1247996813777305722/image.png?ex=66620f1b&is=6660bd9b&hm=e447486b602800f924f57c6ef73448c2023e69e893145591c57f2fd22481a3c7&
b
haha yeah, it just means you've reached 1/1 always alives
this is for people who buy 10 and gradually introduce them
g
Hi @bumpy-butcher-41910, I just wanted to note that toggling Always Alive hasn't improved the response time of my bot, unfortunately. I just tested it and it took 18 seconds from my initial message before I got the first response.
b
just to confirm - you published your bot after enabling always alive?
g
No, the bot was already live.
b
you may need to publish to see the changes activated! can you try that and let me know?
g
Sure, I'll give that a whirl now.
Now it takes 8 seconds to respond, so, better?
n
@bumpy-butcher-41910 re https://discord.com/channels/1108396290624213082/1240100619193290852/1240102588628734002 We've set an init to auto open chat and start convo....Give your comment in the above URL. Does the bot instance start as soon as chat window opens or is it from when the first question is asked? Wondering if I can auto start a convo on init chat to speed up first response?
12 Views
PreviousNext
Powered by