Feature request for having chat gpt style chat response.. as it gives feeling of continus stream specifically for long response. @loud-crowd-60573 When will this be implemented?

Hey @some-apple-9254 Can you provide an example?

When a user asks a question to a ‘Botpress’ chatbot, they receive the answer once it has been fully written. Therefore, they may have to wait anywhere from 15 seconds to much longer (1 minute).

I think that depends on your workflow! The more work the LLMs have to do, the longer it takes to provide a response! For example I did a basic bot and it responds in less then 2 seconds

Yes, I know. But I haven't received an answer to my question. 😢

Ah - I understand, you want the answer to start being typed out as the final answer is being generated! That is a good suggestion @some-apple-9254 I do not have an exact time for "when" but the team actively reviews all the #1111026806254993459 🫡 This would be amazing implimentation for-sure!

@some-apple-9254 that would need a complete review of how Botpress works , since the messages you can send to the user are currently fixed (either a defined text or a variable that is defined above

And what about others platform whatsapp, telegram, etc they should accept streamed output

Okay, but it's extremely frustrating for us and for users, because the system has become low-end. I get feedback at least once a week from customers, etc., asking me when the feature will be available, because the response time is too long.

what llm are you using? if you're using something like claude 4 or gemini 2.5 then streaming probably wouldn't help you a whole lot since the problem is latency (time to first token) and not actual tokens per second

4.1 and 4.1 mini

yeah they're pretty slow, streaming would probably help if you're not getting high latency