This depends very much on the size of the code base, the amount of data in the DB and (of course) the quality of the ORM.

It sounds like you are lucky enough that you have never had an ORM generating badly optimised/n+1/over-eager queries that take down a production service. Or perhaps had to debug low level query cache issues causing unexpected problems.

I'm not advocating for plain SQL, just offering some suggestions as to why someone might want you to consider it.