Knowledge Base Issue
# 🤝helpw
wide-oyster-38514
08/23/2023, 7:23 PMHello,
I created a customer support bot for my website. I uploaded my own documents and instructed the bot to only answer based on provided documents. However, sometimes the bot answers complete unrelated questions. I checked the log, it says it took the answer from one of my documents, I don't have it there, I checked. Also, I don't have any AI tasks enabled or access to the web.
Has this ever happened to anyone? If so how did you fix it? Thank you.
b
bumpy-butcher-41910
08/23/2023, 7:24 PMcan you share an example of one of these answers?
w
wide-oyster-38514
08/23/2023, 7:27 PMIn my database, there is no mention of what statistics is or how to bake a cake, but the bot tends to answer them anyways.
b
bumpy-butcher-41910
08/23/2023, 7:28 PMoh i meant a screenshot if possible!
bumpy-butcher-41910
08/23/2023, 7:28 PMalternatively you can provide me with a report ID (click the BP logo > load problem report > etc) and I can test it out myself
w
wide-oyster-38514
08/23/2023, 7:32 PM@User Sure. Here is the ID link: f585a862-7eca-40e2-9ddc-adfca126b48e
wide-oyster-38514
08/23/2023, 7:32 PMThank you for your help again!
b
bumpy-butcher-41910
08/23/2023, 7:35 PMcan you give me an example of the kind of question that was producing a hallucinated answer?
bumpy-butcher-41910
08/23/2023, 7:35 PMI'm having trouble reproducing the error - I'm getting the correct "I'm unable to assist you with that" message
w
wide-oyster-38514
08/23/2023, 7:36 PMWhat is statistics? What is probability? What is trigonometry?
wide-oyster-38514
08/23/2023, 7:36 PMThese are one of the few I know so far
b
bumpy-butcher-41910
08/23/2023, 7:37 PMbizarre, I was able to get that to work
bumpy-butcher-41910
08/23/2023, 7:37 PMlet me double check
w
wide-oyster-38514
08/23/2023, 7:38 PMIf you can ask a general question first, then maybe the question?
https://cdn.discordapp.com/attachments/1143988990257664060/1143992666745491578/Screenshot_2023-08-23_at_22.28.31.png▾
wide-oyster-38514
08/23/2023, 7:38 PMHere is the screenshot
b
bumpy-butcher-41910
08/23/2023, 7:41 PMoh yeah I was able to get the hallucinated answer I mean
bumpy-butcher-41910
08/23/2023, 7:42 PMthis is definitely a GPT hallucination, but I can't see why it's answering the question based on the information it found
bumpy-butcher-41910
08/23/2023, 7:42 PMif you pull up the citations for this answer and the raw answer from the KB, you'll see the information it pulls has nothing to do with statistics
bumpy-butcher-41910
08/23/2023, 7:42 PMlet me flag this for our team so we can look into it
w
wide-oyster-38514
08/23/2023, 7:43 PMYes please, this literally what I was wondering. I was looking at the citation and couldn't understand whee it pulls the data from.
wide-oyster-38514
08/23/2023, 7:44 PMThank you anyways for your help with this
4 Views