Your last argument could apply to anything really.

Why should I subsidize farmers if they can't compete?

Why do I have subsidize our own manufacturing companies if they can't compete so their workers have a job, at my expense?

Why do I need to subsidize car owners to have yet another lane but can't get a decent train instead?

Here in Poland suddenly all miners pretend to be subsidized by the state, even if they work for private companies.

Why do I need to subsidize them if the companies they work for can't turn a profit, or when they did for decades chose to pay dividends and do buybacks instead of investing? And now I pay the bill?

I mean, at some point you need to cope with the fact that money has to be spent and circulate in some fashion to promote economic activity and projects.

You could argue that subsidizing solar brings energy prices down in any case.