Using new 'Vision Agent' card without a pre known ...
# 🤝help
l
Hi i'm trying to get AI to analyse images sent in by users via WhatsApp. I've got access to a new card under 'Agents' called "Extract Content from Image" which seems like it would do the job. However... it seems to require me to insert a url of the image to analyse, which in my case will be unknown (because the user sends the image in) Anyone have any experience with this kind of use case? Ps Warning in advance. I've recently discovered that I am basically code illiterate. https://cdn.discordapp.com/attachments/1231982274829094945/1231982275046932634/Screenshot_2024-04-22_at_15.49.06.png?ex=6638efe7&is=66267ae7&hm=61fa4538493ceac53438cf5efb48d4461ce36f695ab3dfd1c0f8cb51e14561a3& https://cdn.discordapp.com/attachments/1231982274829094945/1231982275273560145/Screenshot_2024-04-18_at_15.10.48.png?ex=6638efe7&is=66267ae7&hm=4970ed5b005a9770e59ba2f47fc18da467345f86519845a40d496ef7f20b8433&
f
Hey there, You can include a variable in the image url part.

https://youtu.be/deElt8Blwh0?si=orrSukQBmhTMF8h6

I haven't tried it, but I am sure that someone like @bumpy-addition-21507 or @limited-pencil-78283 has done something similar before. https://botpress.com/docs/cloud/channels/whatsapp/#media-images-audio-documents
f
Probs a bad url
l
What would make a url good or bad? I'm now trying to have the image analysis done via a Zap in Zapier. The rest done via Botpress still
this one does work
f
It has to be publicly available
l
Ok, got it. Thanks. I've actually now made it so that the url input field on the card "extract content from image" to work when there is a variable put in it, instead of just a url. Now I just need to save/store the incoming WhatsApp image as a variable somehow?
f
Remember to use the scope like workflow or user So it would be @workflow.testimage if the scope is workflow
I unfortunately don't know how to save and use the image from Whatsapp
l
Well spotted, thanks. I'm getting there slowly. Hopefully i'll be the worlds expert on whatsapp image saving soon 😂
f
I am sure that you will!🛠️
h
@fresh-fireman-491 - I have been working in the above approach and seems like little problem. I have created a variable with Userinputurl for extract content from image card and passing this value to the card and storing the output with other output variable "image". But when i use the output variable in the text card it says value as "undefined". but strangely when i use the input variable "Userinputurl" it is showing the answer which is expected.
f
That sounds weird. Could you create a new post in #1111009377525186570 and share some more information including examples
3 Views