▲ | motorest 13 hours ago | ||||||||||||||||
> That just means you have to be smart about retention. It's not a problem of retention. It's a problem caused by the sheer volume of data. Telemetry data must be stored for over N days in order to be useful, and if you decide to track telemetry data of all tyoes involved in "wide events" throughout this period then you need to make room to persist it. If you're bundling efficient telemetry types like metrics with data intensive telemetry like logs in events them the data you need to store quickly adds up. | |||||||||||||||||
▲ | killme2008 13 hours ago | parent [-] | ||||||||||||||||
Agree. The new wide event pipeline should fully utilize cheaper storage options-object storage like S3. Includes both cold and hot data and maintains performance. | |||||||||||||||||
|