It would be a great idea to have the capability to choose between ChatGPT and Llama 3.1 AI. 🤔

This is a great idea! I'm sure it is just around the corner.

One option to use Llama in Botpress is Groq API, works well 🛠️ https://discord.com/channels/1108396290624213082/1230732214891712674/1230947947626106890 So far, they have added all Llama models quickly (in a few hours) to the free API. Now it seems that for the biggest model 405B, free users have to wait a little bit. "Early API access to Llama 3.1 405B is currently only available to paying customers - stay tuned for general availability. During preview launch, we are limiting all 3.1 models to max_tokens of 8k and 405b to 16k input tokens." https://console.groq.com/docs/models

Whats the api rate limits?

I have these https://cdn.discordapp.com/attachments/1265434380084707379/1267128722201514105/image.png?ex=66a7a915&is=66a65795&hm=50fe2ae48565a17f835fee24c68c49ff80ec6da2f318e8080848ba1a4f9ec578&