Reimagining LLM Memory: Using Context as Training Data Unlocks Models That Learn at Test-Time

NVIDIA Research introduces TTT-E2E (Test-Time Training End-to-End), a novel approach that enables LLMs to compress context into their weights during inference through next-token prediction. Unlike traditional transformers with full attention that scale poorly in latency, or RNNs that lose accuracy with longer context, TTT-E2E Show more