Remix.run Logo
yzydserd 8 hours ago

> So I built a scraper that hits the UK government's mandatory Fuel Finder API every 10 minutes and stores every price change. 90k records across 7,700 stations since January.

Only 1 change per station per week on average? Fewer than I expected. Not sure I'd call it a scraper, myself.

157p/L national average is about 8 USD/G.

traceroute66 6 hours ago | parent | next [-]

> Only 1 change per station per week on average? Fewer than I expected.

My uneducated guess is it correlates to the weekly delivery of fuel. ;-)

theazureguy 8 hours ago | parent | prev [-]

fair point on scraper, it's more of an ingest pipeline really. the 90k is total price records across 7,700 stations since january, stations update a few times a week on average. the 10 min polling catches every move when it happens. the value is in the per-station, history over time, not the raw volume.