Chatbot Provides Information that is NOT in the KB
# 🤝helpf
famous-zoo-73118
07/25/2023, 4:11 PMI think the KB agent eagerly tries to have an answer for all questions, as GPT seems to be taking over when no answer is found in the KB.
famous-zoo-73118
07/25/2023, 4:13 PMI just touched base with the relevant team and it seems it's a known issue with the GPT model as it's being instructed to not provide an answer outside of the KB but it's still doing it, and they'll be make some adjustments soon to try to improve this.
famous-zoo-73118
07/25/2023, 4:16 PMAs a possible workaround in the meantime, I could suggest using the context field in the Knowledge Base Agent settings in the Studio to tell it again to not answer outside of the KB:
https://cdn.discordapp.com/attachments/1133424050211926097/1133432540015890472/image.png▾
c
crooked-van-25152
07/25/2023, 4:23 PMThanks @famous-zoo-73118 !
l
late-breakfast-99706
07/25/2023, 5:49 PMHi @famous-zoo-73118 , it did not work this way nor any other way I tried.
So at the moment the only thing there is to be done is wait for this issue to be fixed?
Thanks for the support, at least I know it's not something I am doing wrong on my side
f
famous-zoo-73118
07/25/2023, 6:29 PMI see, thanks for letting us know. Yes, unfortunately it seems to be an issue with the GPT model, hopefully we can find a way to fix it for sure!
3 Views