We figured out the issue. It was with the query prompt! An addition we made was resulting in unintended filtering of answers. It has now been fixed. Thanks for the tips though.