Remix.run Logo
lampiaio 8 hours ago

Reminds me of a funny WWII story:

Kenneth Arrow and his statisticians found that their long-range forecasts were no better than numbers pulled out of a hat. The forecasters agreed and asked their superiors to be relieved of this duty. The reply was: "The Commanding General is well aware that the forecasts are no good. However he needs them for planning purposes."

cogman10 7 hours ago | parent | next [-]

I think it was a stats class where I learned this, but as it turns out bad weather is less common than good weather. To be a fairly accurate weather person, you merely need to say "there will be no precipitation" and you'll be right like 90% of the time anywhere on earth.

What makes that funny is that historically, weather forecasters have been less than 90% accurate.

Now, I will say that today's weather models are pretty dang amazing. The 10 day forecast rarely wrong for me.

dhx an hour ago | parent | next [-]

Take for example Chongqing, China which is one of the world's cloudiest and most overcast cities[1]. Easily confirmed by lack of cloudless satellite imagery.[2] You could get the forecast correct most of the time by just assuming it will be cloudy.

What is more interesting for meteorological forecasting is the time-sensitive details such as:

1. We know severe storms will impact city X at approximately Ypm tomorrow. Will it include large hailstones? Severe and destructive downdraft / tornado? What path will the most damage occur and how much notice can we provide those in the path, even if it's just 30min before the storm arrives?

2. Large wildfire breaks out near city X and is starting to form its own weather patterns.[3] What's the possible scenarios for fire tornadoes, lightning, etc to be formed and when/where? Will the wind direction change more likely happen at Ypm or Y+2pm?

I'm skeptical that AI models would excel in these areas because of the time sensitivity of input data as well as the general lack of accurate input data (impacting human analysis too).

Maybe AI models would be better than humans at making longer term climate predictions such as "If [particular type of ENSO/IOD/etc event] is occurring, the number of cloudy days in [city] is expected to be [quantity]/month in [month] versus [quantity2]/month if the event was not occurring." It's not that humans would be unable to arrive at these type of results -- just that it would be tedious and resource intensive to do so.

[1] https://en.wikipedia.org/wiki/List_of_cities_by_sunshine_dur...

[2] https://imagehunter.apollomapping.com/search/90e4893eeeaa48a...

[3] https://en.wikipedia.org/wiki/Cumulonimbus_flammagenitus

strangegecko 6 hours ago | parent | prev | next [-]

I regularly encounter days when today's forecast is wrong and even in conflict with the current situation.

E.g. the weather app tells me there's a drizzle all day and currently and yet it's entirely dry. The opposite happens too.

Days of rain often shift in increments of days one or two days before as well.

I'd say it's location specific how accurate predictions are.

Quarrel 3 hours ago | parent | prev | next [-]

I heard it (again, I think it was a stats class) as:

Forecasting that what is happening today, will happen tomorrow, was an almost insurmountable baseline for early forecasters.

A bit like trying to come up with psych drugs that can beat a placebo. Although, placebos are particularly effective for psych treatments.

AYBABTME 4 hours ago | parent | prev | next [-]

I think this depends a lot on the region. I find that forecast quality differs widely from region to region. My guess is that it's a matter of (1) some regions have less advanced models available to them and (2) some regions have fundamentally more complex and unpredictable weather patterns.

Concrete if anecdotal example: weather forecast in SF are fairly accurate but the weather patterns are also simple to predict with the Pacific High and the simpler high level mechanics at play. Weather forecasts in Seoul are quite often completely wrong, but the weather patterns are also much more dynamics at a macro level with competing large systems in China/Gobi desert and the Western Pacific.

I'm not a meteorologist, just a sailor who likes to look at weather.

mikestorrent 6 hours ago | parent | prev | next [-]

Your fairly accurate weather person is going to have to stay away from Vancouver / the Pacific Northwest ;-)

5 hours ago | parent [-]
[deleted]
jowea 6 hours ago | parent | prev [-]

I think false negatives (i.e. it rains when it's not supposed to) are both more bothersome and noticeable, so your weather person won't be very popular.

empath75 8 hours ago | parent | prev | next [-]

There is a fairly compelling argument that divination in the ancient world was not a useless waste of time, as is commonly assumed, but that having either a process or a person that can make essentially random choices for them allowed people to make hard, consequential decisions where they might otherwise be paralyzed, especially when the penalty for not acting was worse than making a mistake.

tekkk 7 hours ago | parent | next [-]

Never thought of that. Probably a bit too generous given that it could be just as well waste of time and resources, nevermind the bias of the voodoo doctor. Most of it was just weirdly provided therapy I suppose to relieve stress.

But it is funny that humans put a great lot of weight on social contracts and being given explicit orders, maybe even publicly, must help pursuing action instead of rumination. Especially in a world where things seemed to happen randomly anyway.

schiffern 5 hours ago | parent [-]

"Evolution doesn't optimize for correctness, it optimizes for minimum error cost."

It's a subtle but important distinction.

generativenoise 3 hours ago | parent [-]

That is such a good line. Another important note is the time horizon of that error function is often quite short.

jeffparsons 6 hours ago | parent | prev | next [-]

Additionally, what has been the correct choice five years in a row might be catastrophically wrong in the sixth year. We need some randomness injected into our behaviour so that some people are always making "suboptimal" choices, to stop everyone from crowding into one local maximum and then getting swept away when the rare but inevitable flood comes along.

twoodfin 7 hours ago | parent | prev | next [-]

Fascinating. I suppose it also encourages developing adaptable strategies that accommodate imperfect information, vs. succumbing to wishful thinking or other forms of cognitive bias.

Bjartr 5 hours ago | parent | prev | next [-]

IIRC, the value of randomness went even further than that. I think it was in the allocation of land for rice paddies. I-ching was used to decide if any given farmer's land was to be used that year or something like that. The benefit wasn't divination selecting better land, but by way of random selection, gave an impersonal excuse to leave fields unplanted some years, which is beneficial in the long term to overall yield.

OisinMoran 7 hours ago | parent | prev | next [-]

I've also read that a source of randomness like that could help prevent things like over-extracting some land

5 hours ago | parent | prev [-]
[deleted]
vismit2000 an hour ago | parent | prev [-]

As Dwight D. Eisenhower says: "Plans are useless, but planning is indispensable."