Introversion means "finding company tiring". It doesn't mean you don't enjoy company. Most (but not all) introverts find company to be pleasurable for a limited period of time.

> 3 or 4 people who I know well is optimal for me.

Then invite 3 or 4 people over. That's much more than what most people do. Sounds like the optimal party size to me.