This architecture still hallucinates since it's still using transformers right?

Hallucinations are a result of using statistical models on data. Not just transformers have this issue.