A option to pick KB model by hand (GPT3.5/4) For ...
# 👀feature-requestsr
rhythmic-lizard-47527
04/03/2024, 8:52 AMIt can reduce cost when needed!
rhythmic-lizard-47527
04/03/2024, 11:55 AMexample: when you have a node with AI generative card that is on GPT3 model and you run in your KB the HYBRID model
it still uses GPT4 for no reason and spends 2X more than needed.
this type of situations can be solved with the option I have mentioned.
r
rich-battery-69172
04/06/2024, 4:58 PMAll agents (except KB which is configurable) are using GPT-3.5
For each AI Tasks node, you can click the Advanced option on the card to pick the model you want.
r
rhythmic-lizard-47527
04/07/2024, 7:44 AMBut when i have a node with AI task \ generate text on 3.5 and we use Hybrid mode it will use both of them
r
rich-battery-69172
04/07/2024, 2:14 PM4 will only be used when 3.5 is not able to answer.