linkdrift
The Window Got Bigger. The Memory Did Not.

The Window Got Bigger. The Memory Did Not.

Vishal Sachar
@vsachar·1.8K followers
·12 min read

The upgrade looked like the end of a familiar complaint. The assistant that lost the thread halfway through a long contract, that forgot the decision taken three exchanges earlier, that had to be told

The upgrade looked like the end of a familiar complaint. The assistant that lost the thread halfway through a long contract, that forgot the decision taken three exchanges earlier, that had to be told the same context every morning, was about to get a window big enough to hold everything. In February 2024 Google said Gemini 1.5 Pro had “found the embedded text 99% of the time” in blocks of up to a million tokens, and that its researchers had tested ten million (Google, 2024). In April 2025 Meta

9
0
9
0
Read full article on X

more from @vsachar