| ▲ | zhyder 2 days ago | |||||||
Big knowledge cutoff jump from Sep 2024 to Aug 2025. How'd they pull that off for a small point release, which presumably hasn't done a fresh pre-training over the web? Did they figure out how to do more incremental knowledge updates somehow? If yes that'd be a huge change to these releases going forward. I'd appreciate the freshness that comes with that (without having to rely on web search as a RAG tool, which isn't as deeply intelligent, as is game-able by SEO). With Gemini 3, my only disappointment was 0 change in knowledge cutoff relative to 2.5's (Jan 2025). | ||||||||
| ▲ | throwaway314155 2 days ago | parent [-] | |||||||
> which presumably hasn't done a fresh pre-training over the web What makes you think that? > Did they figure out how to do more incremental knowledge updates somehow? It's simple. You take the existing model and continue pretraining with newly collected data. | ||||||||
| ||||||||