why is the ai task card not outputting properly? i...
# 🌎general
l
why is the ai task card not outputting properly? it was fine yesterday
a
looks like a timeout, I think it may be due to too many requests / people using it at once. I saw we had those this morning. We are working to fix this. Are you still experiencing it?
l
yes sometimes i think it went fine when I cleared cache and refreshed.
also while I on this topic, is there like a standard guide like on how to utilize ai task card to its extent like is there a max characters limit or outputs before the ai doesn't recognize the task? yesterday I had a flow which outputted what I want, ran several tests the night before and today it doesn't output the same result even though the prompt/flow was virtually unchanged. I'm thinking it's maybe due to tokens or something I'm new at this but is there another reason?
here are the output comparisons from yesterday and today. notice a decline in quality, I thought I solved it but it came back. Also that "Yes, Yes,no,no" output wasnt consistent. sometimes it just repeats what it said

https://cdn.discordapp.com/attachments/1130809951317676072/1130866944803872798/image.png

https://cdn.discordapp.com/attachments/1130809951317676072/1130866945034571887/image.png

a
tokens can be a factor in variance. There's also the fact that LLMs have a probability of outputing differently each time
l
right now, using the summary agent as AI task input, it just outputs the chat conversation history completely ignoring the prompt. Really confused, this same setup worked fine yesterday
by the way, thank you for replying and assisting I appreciate it
r
@limited-forest-26830 hey would you mind sharing your prompt settings so I can have a look at it? (the description, input and temperature)
l
Right now, after alot of tweaking its kind of close to what it generated yesterday

https://cdn.discordapp.com/attachments/1130809951317676072/1130874172436914226/image.png

https://cdn.discordapp.com/attachments/1130809951317676072/1130874173040885931/image.png

oh wait i reran the test and it just gave me this, didn't follow the format:

https://cdn.discordapp.com/attachments/1130809951317676072/1130875271986303097/image.png

am I putting on a too heavy prompt for ai task card? should I use chatgpt openai for the prompt and on what I want to output? my current plan is to use botpress ai task card as much as possible and yesterday it was going smoothly but now I'm at this roadblock. Is it possible to utilize AI task card for this? I really thought it was going well yesterday
r
It should work, but it is a hard one for the AI Task. Can you try raising the temperature a bit? Also, if you could copy/paste this prompt to me & give me an example of transcript I could have a look to better the prompt
Giving an example usually really really helps and makes it really robust over time. Do you happen to have an example you can give it? (perhaps use ChatGPT then copy/paste a satisfactory answer as example)
l
right, is it okay if I message you directly? just to make it more detailed
r
yes