It's been done.

https://github.com/haykgrigo3/TimeCapsuleLLM