{"version":"1.0","generated_at":"2026-10-08T00:20:08.912384","id":941,"slug":"ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources","title":"趋势解读：AI models often give the right answers but，聚焦形式化数学证明能力","summary":"北京大学和上海人工智能实验室推出CiteVQA基准，测试AI模型在文档问答中的归因准确性，发现顶尖模型仅得分76，开源模型普遍低于25，暴露归因幻觉问题。","abstract":"趋势解读：AI models often give the right answers but，聚焦形式化数学证明能力 北京大学和上海人工智能实验室推出CiteVQA基准，测试AI模型在文档问答中的归因准确性，发现顶尖模型仅得分76，开源模型普遍低于25，暴露归因幻觉问题。 CiteVQA揭示AI模型答案正确但归因错误的问题 顶尖模型归因准确率仅76分，开源模型低于25分 归因能力直接影响答案质量，尤其在法律、医疗等要求可追溯的领域 模型在复杂布局和跨文档任务上表现更差 仅仅因为语言模型解决了有关 PDF 的问题，并不意味着它实际上找到了它声称的答案。北京大学和上海人工智能实验室的研究人员建立了一个名为 CiteVQA 的新基准，以揭示获得正确答案和指出正确来源之间的差距。他们称之为“归因幻觉”。标准文档分析测试（如 DocVQA 或 MMLongBench-Doc）仅对最终答案进行评分。他们无法判断模型是否确实从文档中提取了信息，或者只是根据已知信息进行猜测。然而，该论文认为，在法律、财务审计或医学领域，可追溯性是人工智能输出可用的首要因素。 CiteVQA 使模型用文档中的精确标记来支持每个陈述。他们必须指出确切的段落、表格或图形。仅靠页码是不行的。该数据集涵盖来自七个主题领域的 711 个 PDF 中的 1,897 个问题：其中 451 个英文，260 个中文。这些文档平均每份有 40.6 页，比大多数基准测试要长得多。该团队没有手工标记所有内容，而是建立了自动化管道。它将文档分解为单独的元素，让 Gemini 3.0 Flash 等模型追踪证据链，然后检查哪些部分是真…","access_level":"public","access_label":"公开","access_mode":"full","is_preview":false,"canonical_url":"https://opc.beizhux.com/content/941/ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources","html_url":"https://opc.beizhux.com/content/941/ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources","json_url":"https://opc.beizhux.com/content/941/ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources.json","published_at":"2026-05-25T15:30:09","updated_at":"2026-10-06T22:56:42","category":{"slug":"hotspots","name":"全球热点解读"},"source":{"site":"the-decoder.com","author":"Jonathan Kemper","url":"https://the-decoder.com/ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources/"},"tags":["AI","AI评估","CiteVQA","The Decoder","可解释性","归因幻觉","文档理解","研究","语言模型"],"topics":[{"slug":"ai-daily","name":"AI日报","url":"https://opc.beizhux.com/topics/ai-daily","reason":"这篇内容命中「热点解读」等主题信号。"},{"slug":"ai-tools","name":"AI工具","url":"https://opc.beizhux.com/topics/ai-tools","reason":"这篇内容命中「模型」等主题信号。"},{"slug":"agent-workflow","name":"Agent工作流","url":"https://opc.beizhux.com/topics/agent-workflow","reason":"这篇内容来自该专题长期覆盖的栏目。"}],"keywords":["全球热点解读","AI日报","AI工具","Agent工作流","每日AI日报","AI信号","热点解读","BuilderPulse","工具","自动化","模型","Cursor"],"questions":[{"question":"趋势解读：AI models often give the right answers but，聚焦形式化数学证明能力主要讲什么？","answer":"北京大学和上海人工智能实验室推出CiteVQA基准，测试AI模型在文档问答中的归因准确性，发现顶尖模型仅得分76，开源模型普遍低于25，暴露归因幻觉问题。"},{"question":"这篇文章最值得关注的要点是什么？","answer":"北京大学和上海人工智能实验室推出CiteVQA基准，测试AI模型在文档问答中的归因准确性，发现顶尖模型仅得分76，开源模型普遍低于25，暴露归因幻觉问题。；CiteVQA揭示AI模型答案正确但归因错误的问题；顶尖模型归因准确率仅76分，开源模型低于25分；归因能力直接影响答案质量，尤其在法律、医疗等要求可追溯的领域"},{"question":"这篇文章和哪些AI专题相关？","answer":"它适合放在AI日报、AI工具、Agent工作流专题里阅读。 关联原因：这篇内容命中「热点解读」等主题信号。；这篇内容命中「模型」等主题信号。；这篇内容来自该专题长期覆盖的栏目。"},{"question":"阅读这篇文章建议先理解哪些关键词？","answer":"建议先理解AI日报、每日AI日报、AI信号、热点解读、BuilderPulse这些关键词，再结合正文判断工具、机会或风险是否值得进入自己的工作流。"}],"terms":[{"slug":"ai-daily-term","name":"AI日报","definition":"在AI觉醒星球里，「AI日报」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-daily-term","path":"/glossary/ai-daily-term","json_url":"https://opc.beizhux.com/glossary/ai-daily-term.json"},{"slug":"daily-ai-briefing","name":"每日AI日报","definition":"在AI觉醒星球里，「每日AI日报」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/daily-ai-briefing","path":"/glossary/daily-ai-briefing","json_url":"https://opc.beizhux.com/glossary/daily-ai-briefing.json"},{"slug":"ai-signal","name":"AI信号","definition":"在AI觉醒星球里，「AI信号」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-signal","path":"/glossary/ai-signal","json_url":"https://opc.beizhux.com/glossary/ai-signal.json"},{"slug":"ai-news-analysis","name":"热点解读","definition":"在AI觉醒星球里，「热点解读」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-news-analysis","path":"/glossary/ai-news-analysis","json_url":"https://opc.beizhux.com/glossary/ai-news-analysis.json"},{"slug":"builderpulse","name":"BuilderPulse","definition":"在AI觉醒星球里，「BuilderPulse」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/builderpulse","path":"/glossary/builderpulse","json_url":"https://opc.beizhux.com/glossary/builderpulse.json"},{"slug":"ai-tools-term","name":"AI工具","definition":"在AI觉醒星球里，「AI工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-tools-term","path":"/glossary/ai-tools-term","json_url":"https://opc.beizhux.com/glossary/ai-tools-term.json"},{"slug":"tools","name":"工具","definition":"在AI觉醒星球里，「工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/tools","path":"/glossary/tools","json_url":"https://opc.beizhux.com/glossary/tools.json"},{"slug":"automation","name":"自动化","definition":"在AI觉醒星球里，「自动化」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/automation","path":"/glossary/automation","json_url":"https://opc.beizhux.com/glossary/automation.json"}],"preview_hidden_sections":[],"related_items":[{"id":3286,"title":"我们正在进入一个发现的新时代：","url":"https://opc.beizhux.com/content/3286/we-are-entering-a-new-era-of-discovery-now","summary":"Sam Altman 在 X 上发声称，我们正在进入一个发现的新时代。这是一条极简但方向性强的公开信号，值得关注其后续指向的 AI、科研与产品探索节奏。","access_level":"public"},{"id":3285,"title":"【必读】每日AI日报 2026-10-07","url":"https://opc.beizhux.com/content/3285/aihot-daily-2026-10-07","summary":"AIHOT 每日 AI 日报：模型发布/更新： - Mistral 发布 Mistral Large 4，Artificial Analysis 评测称其为美中之外最智能模型：Mistral 发布 Mistral Large 4（Research Public Preview），在 Artificial Analys…","access_level":"public"},{"id":3271,"title":"OpenAI 发布内部前沿模型产出的数学研究成果","url":"https://opc.beizhux.com/content/3271/openai-19","summary":"OpenAI 公开一批由内部前沿模型产出的数学成果，成果以 GitHub 仓库发布，并附论文修订与引用协议，许多证明已用 Lean 形式化以便计算机验证。","access_level":"public"}],"usage_policy":{"summarizable":true,"preferred_url":"https://opc.beizhux.com/content/941/ai-models-often-give-the-right-answers-but-point-to-the-wrong-sources","private_fields_excluded":true}}