What are those more relevant things cryptographers should be working on?

No idea, but if the funding wasn't concentrated in PQ both commercially and academically, it could be spread to other areas of tangible benefit. All I see is bloated key sizes, retrofitting and re-architecture for an issue that isn't even in its infancy. I see it as akin to how cryptocurrency has taken mindshare and resources and hasn't produced anything useful to users.