Are models capable of generating citations? Every time I've asked for citations on ChatGPT they either don't exist or are incorrect.

They can't pull citations out of their own weights, but if you give them tools to look up man pages (possibly annotated with line numbers), they could cite the lines that support their claims.