The price of oil isn't just about the "cost of gas at the pump". It's about how much it costs to transport anything. There aren't many products that don't need to be transported or that don't depend at least partially on something that does.

So yeah, when the price of oil goes up, oil companies make more money, and prices go up for pretty much everyone.