资讯

Nvidia researchers argue huge AI context windows are a dead end

📅 2026-11-21 ⏱️ 约 2 分钟阅读 ✍️ AI导航编辑部 🔗 the-decoder.com
Nvidia researchers argue huge AI context windows are a dead end
📝 内容摘要

Nvidia researchers argue huge AI context windows are a dead end Language models can now process entire novels at once. A

📌 核心要点

  • Continue reading with THE DECODER+
  • - Every Plus article and the full archive
  • - Frontier Radar: 6 deep dives a year

Language models can now process entire novels at once. An Nvidia research team says that's often overkill and expensive. In many tests, periodic summaries and targeted lookups worked about as well.

A language model's context window is its working memory, covering everything it holds in view when generating a reply. Over the past few years, that window has grown rapidly. GPT-4 launched in March 2023 with 8,192 tokens. Today, GPT 5.6 Sol handles around one million tokens, about 120 times as much and enough for Tolstoy's "War and Peace."

THE DECODER+

Continue reading with THE DECODER+

- Every Plus article and the full archive

- No ad banners

- Frontier Radar: 6 deep dives a year

Already a subscriber? Sign in Back to the homepage

来源the-decoder.com· 本文为编辑整理,仅供参考