Hey folks, awesome product! I wonder if streaming is supported in the chatbot? i.e. if I receive token by token generation, can I see it in the chatbot, instead of waiting for the entire message?
f
fresh-fireman-491
01/23/2024, 4:35 PM
Hey
Streaming is not supported as the message has to be processed before being sent but I will ask the team if its something they have on their road map.
f
flaky-ability-96739
02/16/2024, 7:22 AM
Would like this for the AI task responses too. The message processing could just be a time in the stream where nothing is sent back. Streaming could start as soon as there's something being returned by openAI.