Bot skips AI Task on website
# 🤝helpd
dry-doctor-40460
06/03/2023, 9:39 PMWhen I put the bot on my website, it completely skips an AI task. The bot works great and as intended on the Botpress test website though.
dry-doctor-40460
06/03/2023, 9:39 PMf
fierce-terabyte-74126
06/04/2023, 3:45 AMIt seems like a prompt issue, what's your temperature?
d
dry-doctor-40460
06/04/2023, 5:05 AMlike 0.8
f
fierce-terabyte-74126
06/04/2023, 5:26 PMYeah, that's too high...
a
acceptable-kangaroo-64719
06/05/2023, 10:22 AMYep, a temperature of 0.8 is really high. Unless it's a creative application, I wouldn't advise temperatures above 0.3.
If you're looking to learn more about prompting strategies, this free course from DeepLearning.ai really helped me: https://www.deeplearning.ai/short-courses/chatgpt-prompt-engineering-for-developers/
d
dry-doctor-40460
06/05/2023, 7:39 PMI have a creative task however, will the application just not work with temperatures that high?
f
fierce-terabyte-74126
06/05/2023, 7:44 PMThe higher the temperature the more creative will the AI be with its answers, it's not that isn't going to work but you need to be more restrictive with your prompt if you want specific answers...
a
acceptable-kangaroo-64719
06/06/2023, 10:19 AM⬆️ this. LLMs will hallucinate more on higher temperatures. This can be countered by providing additional context and instructions in the prompt, but only to a point. I'd recommend starting with a low temperature (0.1 or 0.2) and then incrementally increase until you no longer see any more benefits.
6 Views