> My personal experience has show that it still regularly makes up garbage and throws in nonsense sources that do not back up its claims.

When coding? I feel like it only makes mistakes anywhere near that when my prompting is lazy or stupid. As long as I feed it enough context its really good but it does overfit a lot still.