hallucinations

#15
by eXt73 - opened

Unfortunately, the model has problems comparing documents, extracting data from xlsx, and comparing it with data in docx. Only when we set the penalty to 2 is it 'so-so'... otherwise it hallucinates. With settings: temp 1/1.15, top_k 20, top_p 8-9.95, repeat_penalty 1.1. I'm testing in Polish.
Zrzut ekranu_20251209_100420

Sign up or log in to comment