People only click from search when they have actual need to visit the site. E-commerce, image/video content, social media, etc.

That is pretty much as it should be.

This! Why would I go and read 2000 words optimized article for SEO when I can get the answer in one line?

I only go to a website to perform an action as you said.