Hey, I've created a bot to read a Notion database, with 500+ entries. But I'm having trouble with storing the data in a workflow variable to use it in the bot. I saw that every time I run the bot, it only stores 100 entries, which makes the AI generation part of the bot inaccurate. Does anyone know about how to help here? If I can't get all the entries in the database the bot becomes useless for me, because I need an accurate bot. https://cdn.discordapp.com/attachments/1253102745792020670/1253102746232426586/Screenshot_2024-06-19_at_18.38.05.png?ex=6674a260&is=667350e0&hm=db5b89f0ca34464dced3758df6db206b0686d4cff1d472511567dd86cb1d6866&

Hey ! i'm not familiar with the botpress notion integration, but maybe you can store every entry in a row of a botpress table, and then use this table as your base (and delete the entries after the process)

Interesting, I'll try that.

don't hesitate to share your progress there ! i'm interested in 😉

Will do 🙂

Okay ! So you choose to store the data in a table or variable ?

I kept in a variable. But, it seems that Botpress' generative AI doesn't handle very well large bulks of information in JSON format. So I'll probably need to clean up the data before going through the generative AI, and I'm thinking of using tables for that.