https://discord.gg/botpress logo
Join Discord
Powered by
Can I make a drawing app in botpress, that also do...
# 🤝help
g
Can I make a drawing app in botpress, that also does image recognition? I am to make a botpress app that would have a node that allows for a drawing pad, and the app will apply image recognition on it and stores that information.
f
Hi there. Are you planning to use this on a website or where would you like to do this?
g
Perhaps on a phone or a tablet, as an app.
f
I think the best way to do this is to send an event to your browser or app which would then open up the drawing pad. You can make an API call in Botpress to GPT Vision with the image. You can either do it with a link or by base64 string encoding the image and then using that. Would recommend you to just upload it to something like an AWS S3 Bucket and then getting the link from that. I got a template hopefully soon coming out that shows you how to do it in the browser. Can be transferred over to an APP with some modifications ofc.
g
"I think the best way to do this is to send an event to your browser or app which would then open up the drawing pad" Which drawing pad would you recommend for me to use?
f
I don't have a lot of knowledge about that unfortunately.
You can take a look here and maybe get some inspiration: https://www.google.com/search?q=drawing+canvas+code+for+apps&client=opera-gx&hs=CkD&sca_esv=595745443&sxsrf=AM9HkKmNhmhC5zxKiL30x5mwhdkvcA_NFQ%3A1704398965919&ei=dRCXZevcN6L9wPAPi6eWmAQ&udm=&ved=0ahUKEwir66z3xMSDAxWiPhAIHYuTBUMQ4dUDCA8&uact=5&oq=drawing+canvas+code+for+apps&gs_lp=Egxnd3Mtd2l6LXNlcnAiHGRyYXdpbmcgY2FudmFzIGNvZGUgZm9yIGFwcHMyBRAhGKABMgUQIRigATIFECEYoAEyBRAhGJ8FMgUQIRifBUi7RFD3BVi4Q3ABeAGQAQCYAWmgAdwMqgEEMjAuMbgBA8gBAPgBAcICChAAGEcY1gQYsAPCAgoQIxiABBiKBRgnwgIREC4YgAQYsQMYgwEYxwEY0QPCAg4QABiABBiKBRixAxiDAcICCxAAGIAEGLEDGIMBwgIKEAAYgAQYigUYQ8ICCxAuGIAEGLEDGIMBwgINEAAYgAQYigUYQxixA8ICChAuGIAEGIoFGEPCAggQLhiABBixA8ICBBAAGAPCAggQABiABBixA8ICBRAAGIAEwgILEC4YgAQYxwEYrwHCAg0QABiABBixAxiDARgKwgIIEAAYgAQYywHCAgYQABgWGB7CAggQABgWGB4YD-IDBBgAIEGIBgGQBgg&sclient=gws-wiz-serp
g
Ah, thanks, but assuming I am able to make these drawing apps, how would I be able to integrate it with Botpress? And is there a free version of GPT vision that I can use with it? Thank you
f
I think most image recognition costs a bit of money unfortunately but there might just be 1 that is free that I don't know about or that you can run on some of your hardware and then call every time. @User anyone knows?
g
Well, for now, how would I be able to integrade a drawing app to a botpress?
f
That is a really good question and I'm honestly not sure. You could check out this page for all of the integrations Botpress has: https://botpress.com/hub?s_id=%24device%3A18bde38ebe64b1-047f945f19adad-16525634-1d73c0-18bde38ebe64b1&pscd=try.botpress.com&ps_partner_key=c2Ftc3RvbmVzaGFsbGViZXJnNTE1NQ&ps_xid=exKsxPkQ6YpivH&gsxid=exKsxPkQ6YpivH&gspk=c2Ftc3RvbmVzaGFsbGViZXJnNTE1NQ Maybe a @User has done this before or has an idea?
PreviousNext
Powered by