I think two things contribute to the trust in LLMs:

1. Decades of generally reliable systems (I trust my calculator because it always says 1+1=2) has trained people to believe what computers say.

2. LLMs "speak" with great confidence, which has, as you say, a psychological effect.