That might work if airlines bought most of their fuel in the spot market. But major airlines tend to hedge their fuel prices, buying fuel that doesn't exist yet for a guaranteed price. If the shortage is severe enough, that fuel might not be delivered, leading to worse disruption than high prices alone would have caused.