If i have larger knowledge base, was AI answering question more costly (higher AI-spend) ? or it is the same?
b
bumpy-butcher-41910
04/24/2024, 3:20 PM
it will indeed increase the cost as the size of your KB scales
bumpy-butcher-41910
04/24/2024, 3:20 PM
however, the model you use is likely to have a higher impact on cost, i.e. 3.5 instead of 4
m
melodic-ice-54318
04/24/2024, 3:48 PM
So it will increase but not that significant? Also how do I change the model? Is it possible to use another model other than from openai gpt (like llama or maybe llm model from hugging face). Really appreciate your answer, thankss
b
bumpy-butcher-41910
04/24/2024, 3:50 PM
you can change the model in the settings for your Knowledge Agent in the studio