AI觉醒星球
Awakening is here
Knowledge File / AI技能杠杆
2026-08-19 0 浏览 会员

你的智能体到底需要多少内存?

智能体记忆并非越多越好,而是需要根据模型能力校准剂量。Hugging Face研究显示,强模型适合完整规则集,弱模型适合精简核心加检索,且精选检索可同时提升准确率和降低成本。

SOURCE / AI技能杠杆 MIN / 4 ACCESS / 会员 POST / 2026-08-19 02:09:38

原贴

查看原文
作者:Hugging Face Blog 来源站点:huggingface.co 原贴时间:

原文

In our previous post , we compared ALTK-Evolve with ACE and showed that how you deliver an agent's self-distilled guidelines — a few retrieved per task vs. the whole set injected — drives both accuracy and cost. This post steps back to the question that comes before it: how much should you give it? Equipping an agent with agentic memory sounds simple: distill lessons from its past work, put them back in context, and more experience should mean better performance. It doesn't always work that way. When we scaled the evaluation to eight models — from a 30B dense model to frontier proprietary systems — one finding stood out: Agentic memory is not a feature you switch on. It's a dose you calibrate to the model. Agentic memory is not a feature you switch on. It's a dose you calibrate to the model. ALTK-Evolve lets an agent learn from its own past trajectories: distilling reusable guidelines and injecting them back at inference time, with no weight updates and no human annotation. ALTK-Evolve lets an agent learn from its own past trajectories: distilling reusable guidelines and injecting them back at inference time, with no weight updates and no human annotation. The right dose differs by model tier: strong models with headroom want the full guideline set, weaker models do best with a compact core plus per-task retrieval, and saturated models show no measurable gain. The right dose differs by model tier: strong models with headroom want the full guideline set, weaker models do best with a compact core plus per-task retrieval, and saturated models show no measurable gain. Curated retrieval can be both the most accurate and the cheapest option: gpt-oss-120b gained +16.1pp task completion at only +5% tokens — and prompt caching keeps even the full guideline set affordable in production. Curated retrieval can be both the most accurate and the cheapest option: gpt-oss-120b gained +16.1pp task completion at only +5% tokens — and prompt caching keeps even the full guideline set affordable in production. Not every model benefits from the same amount of memory. Across eight models spanning the capability spectrum, we saw three recurring patterns: Strong models with headroom want the full guideline set — every guideline, including rare edge-case lessons. They have the capacity to absorb and apply all of it. DeepSeek-V3.2 (671B MoE) climbed +9.5 percentage points in task completion when given its full self-mined guideline set.

中文翻译

在我们之前的文章中,我们将ALTK-Evolve与ACE进行了比较,并展示了如何提供智能体自我提炼的指南——每个任务检索少数几条与注入整个集合——会同时影响准确性和成本。这篇文章退一步探讨之前的问题:你应该给它多少?为智能体配备智能体记忆听起来很简单:从过去的工作中提炼经验,放回上下文中,更多的经验应该意味着更好的表现。但事情并不总是如此。当我们将评估扩展到八个模型——从300亿参数的稠密模型到前沿专有系统——一个发现脱颖而出:智能体记忆不是你可以打开的开关。它是一种需要根据模型校准的剂量。智能体记忆不是你可以打开的开关。它是一种需要根据模型校准的剂量。

ALTK-Evolve让智能体从自己的过去轨迹中学习:提炼可复用的指南,并在推理时注入回去,无需更新权重,也无需人工标注。ALTK-Evolve让智能体从自己的过去轨迹中学习:提炼可复用的指南,并在推理时注入回去,无需更新权重,也无需人工标注。

正确的剂量因模型层级而异:有能力的强模型需要完整的指南集,较弱的模型最适合紧凑的核心加上按任务检索,而饱和的模型则没有可衡量的收益。正确的剂量因模型层级而异:有能力的强模型需要完整的指南集,较弱的模型最适合紧凑的核心加上按任务检索,而饱和的模型则没有可衡量的收益。

精选检索可以同时是最准确和最便宜的选择:gpt-oss-120b在仅增加5%令牌的情况下,任务完成率提高了16.1个百分点——提示缓存甚至让完整指南集在生产中保持可负担。精选检索可以同时是最准确和最便宜的选择:gpt-oss-120b在仅增加5%令牌的情况下,任务完成率提高了16.1个百分点——提示缓存甚至让完整指南集在生产中保持可负担。

并非每个模型都能从相同数量的记忆中受益。在跨越能力谱系的八个模型中,我们看到了三种反复出现的模式:有能力的强模型需要完整的指南集——包括罕见的边缘案例经验。它们有能力吸收并应用所有这些。DeepSeek-V3.2(671B MoE)在获得其完整的自我挖掘指南集时,任务完成率提升了9.5个百分点。

核心信息

智能体记忆并非越多越好,而是需要根据模型能力校准剂量。Hugging Face研究显示,强模型适合完整规则集,弱模型适合精简核心加检索,且精选检索可同时提升准确率和降低成本。

  • 智能体记忆并非越多越好,而是需要根据模型能力校准剂量。Hugging Face研究显示,强模型适合完整规则集,弱模型适合精简核心加检索,且精选检索可同时提升准确率和降低成本。
  • 原贴提到:In our previous post , we compared ALTK-Evolve with ACE and showed that
  • 来源:huggingface.co
试看内容

成为会员查看完整内容

你已经看到了这篇内容的前置整理,剩余深度部分仅对会员开放。

详细解读 信息差价值 参考来源
成为会员查看完整内容
上一篇 Claude Tag 如何担任 Anthropic CI/CD 故障的一线响应者 下一篇 一个实用的深度思考Prompt:用"双向钢人论证"让AI帮你挖出最本质的答案