{"version":"1.0","generated_at":"2026-09-27T14:59:06.706146","id":2308,"slug":"old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale","title":"旧OCR文本阻碍语言模型训练，FineBooks希望大规模解决","summary":"Hugging Face 和 EleutherAI 合作的 FineBooks 项目测试了14个开源OCR模型在历史书籍上的表现，发现小模型优于大模型，最佳模型字符准确率超97%，每千页成本低于2美元。输出质量适合AI训练，但不适合学术用途。项目计划重新处理约20万份BHL文档。","abstract":"旧OCR文本阻碍语言模型训练，FineBooks希望大规模解决 Hugging Face 和 EleutherAI 合作的 FineBooks 项目测试了14个开源OCR模型在历史书籍上的表现，发现小模型优于大模型，最佳模型字符准确率超97%，每千页成本低于2美元。输出质量适合AI训练，但不适合学术用途。项目计划重新处理约20万份BHL文档。 Hugging Face 和 EleutherAI 合作的 FineBooks 项目测试了14个开源OCR模型在历史书籍上的表现，发现小模型优于大模型，最佳模型字符准确率超97%，每千页成本低于2美元。输出质量适合AI训练，但不适合学术用途。项目计划重新处理约20万份BHL文档。 原贴提到：The FineBooks project, a collaboration between Hugging Face and Eleuther 来源：the-decoder.com Hugging Face 和 EleutherAI 合作的 FineBooks 项目，在超过 2,000 页历史书籍页面上对 14 个开源 OCR 模型进行了基准测试，以评估它们将扫描文本转换为 AI 语言模型干净训练数据的能力。较小的模型经常优于较大的模型，表现最好的模型字符准确率超过 97%，每千页成本低于 2 美元。虽然研究人员认为输出质量足以满足 AI 训练目的，但他们指出，这些模型在学术或科学应用中仍然过于容易出错。 Hugging Face 和 EleutherAI 的 FineBooks 项目测试了 14 个开放权重 OCR 模型，在超过 2,000 页历…","access_level":"member","access_label":"免费阅读","access_mode":"full","is_preview":false,"canonical_url":"https://opc.beizhux.com/content/2308/old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale","html_url":"https://opc.beizhux.com/content/2308/old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale","json_url":"https://opc.beizhux.com/content/2308/old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale.json","published_at":"2026-08-11T02:20:39","updated_at":"2026-09-27T14:09:14","category":{"slug":"ai-business","name":"AI小生意项目库"},"source":{"site":"the-decoder.com","author":"Matthias Bastian","url":"https://the-decoder.com/old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale/"},"tags":["AI","AI训练","AI训练数据","EleutherAI","Hugging Face","OCR","The Decoder","历史文献","大语言模型","开源","开源AI","开源模型"],"topics":[{"slug":"ai-side-business","name":"AI副业","url":"https://opc.beizhux.com/topics/ai-side-business","reason":"这篇内容命中「项目、小生意、变现」等主题信号。"},{"slug":"ai-tools","name":"AI工具","url":"https://opc.beizhux.com/topics/ai-tools","reason":"这篇内容命中「模型」等主题信号。"},{"slug":"ai-super-individual","name":"AI超级个体","url":"https://opc.beizhux.com/topics/ai-super-individual","reason":"这篇内容命中「效率」等主题信号。"}],"keywords":["AI小生意项目库","AI副业","AI工具","AI超级个体","工具","自动化","模型","Cursor","Claude","副业","创业","项目"],"questions":[{"question":"旧OCR文本阻碍语言模型训练，FineBooks希望大规模解决主要讲什么？","answer":"Hugging Face 和 EleutherAI 合作的 FineBooks 项目测试了14个开源OCR模型在历史书籍上的表现，发现小模型优于大模型，最佳模型字符准确率超97%，每千页成本低于2美元。输出质量适合AI训练，但不适合学术用途。项目计划重新处理约20万份BHL文档。"},{"question":"这篇文章最值得关注的要点是什么？","answer":"Hugging Face 和 EleutherAI 合作的 FineBooks 项目测试了14个开源OCR模型在历史书籍上的表现，发现小模型优于大模型，最佳模型字符准确率超97%，每千页成本低于2美元。输出质量适合AI训练，但不适合学术用…；原贴提到：The FineBooks project, a collaboration between Hugging Face and Eleuther；来源：the-decoder.com"},{"question":"这篇文章和哪些AI专题相关？","answer":"它适合放在AI副业、AI工具、AI超级个体专题里阅读。 关联原因：这篇内容命中「项目、小生意、变现」等主题信号。；这篇内容命中「模型」等主题信号。；这篇内容命中「效率」等主题信号。"},{"question":"阅读这篇文章建议先理解哪些关键词？","answer":"建议先理解AI工具、工具、自动化、模型、Cursor这些关键词，再结合正文判断工具、机会或风险是否值得进入自己的工作流。"}],"terms":[{"slug":"ai-tools-term","name":"AI工具","definition":"在AI觉醒星球里，「AI工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-tools-term","path":"/glossary/ai-tools-term","json_url":"https://opc.beizhux.com/glossary/ai-tools-term.json"},{"slug":"tools","name":"工具","definition":"在AI觉醒星球里，「工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/tools","path":"/glossary/tools","json_url":"https://opc.beizhux.com/glossary/tools.json"},{"slug":"automation","name":"自动化","definition":"在AI觉醒星球里，「自动化」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/automation","path":"/glossary/automation","json_url":"https://opc.beizhux.com/glossary/automation.json"},{"slug":"ai-model","name":"模型","definition":"在AI觉醒星球里，「模型」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-model","path":"/glossary/ai-model","json_url":"https://opc.beizhux.com/glossary/ai-model.json"},{"slug":"cursor","name":"Cursor","definition":"在AI觉醒星球里，「Cursor」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/cursor","path":"/glossary/cursor","json_url":"https://opc.beizhux.com/glossary/cursor.json"},{"slug":"claude","name":"Claude","definition":"在AI觉醒星球里，「Claude」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/claude","path":"/glossary/claude","json_url":"https://opc.beizhux.com/glossary/claude.json"},{"slug":"side-business","name":"副业","definition":"在AI觉醒星球里，「副业」属于「AI副业」方向。筛选AI副业、AI小生意、项目认知和可收费交付案例，关注普通人可以验证、复制和沉淀的方法。 从真实痛点出发，先做能收费的小验证。","topic_slug":"ai-side-business","topic_name":"AI副业","topic_title":"AI副业：小生意、项目机会与可收费交付","topic_url":"https://opc.beizhux.com/topics/ai-side-business","topic_path":"/topics/ai-side-business","url":"https://opc.beizhux.com/glossary/side-business","path":"/glossary/side-business","json_url":"https://opc.beizhux.com/glossary/side-business.json"},{"slug":"startup","name":"创业","definition":"在AI觉醒星球里，「创业」属于「AI副业」方向。筛选AI副业、AI小生意、项目认知和可收费交付案例，关注普通人可以验证、复制和沉淀的方法。 从真实痛点出发，先做能收费的小验证。","topic_slug":"ai-side-business","topic_name":"AI副业","topic_title":"AI副业：小生意、项目机会与可收费交付","topic_url":"https://opc.beizhux.com/topics/ai-side-business","topic_path":"/topics/ai-side-business","url":"https://opc.beizhux.com/glossary/startup","path":"/glossary/startup","json_url":"https://opc.beizhux.com/glossary/startup.json"}],"preview_hidden_sections":[],"related_items":[{"id":3092,"title":"三分之二的 IT 领导者报告 AI 成果，但很少有人会为此打断 CEO 的假期","url":"https://opc.beizhux.com/content/3092/two-thirds-of-it-leaders-report-ai-results-but-few-would-interrupt-the-ceo-s-vacation-over-them","summary":"AI 泡沫争论的关键问题是 AI 实验室收入能否支撑数据中心建设。Azeem Azhar 分享轶事：约 160 名 IT 副总裁中三分之二有可衡量 AI 成果，但仅约八人认为成果好到能打断 CEO 暑假。企业 AI 回报仍缓慢且难在全经济层面记录，许多公司转向开放权重模型，BCG 调查显示约 70% CEO 有动力美…","access_level":"member"},{"id":3097,"title":"Nvidia 的 SoL-Pi 系统通过优化 harness 将近乎一半的编码 agent token 用量削减","url":"https://opc.beizhux.com/content/3097/nvidia-s-sol-pi-system-cuts-coding-agent-token-usage-nearly-in-half-by-optimizing-the-harness","summary":"Nvidia 论文提出 SoL-Pi，自动优化编码 agent 的控制层 harness。在 EdgeBench 上，token 用量下降 44.7% 到 49%，性能大致持平；按当前 API 价格估算，每小时可节省 4.36 到 13.50 美元。","access_level":"member"},{"id":3084,"title":"使用指标 API 新增拉取请求审查阶段","url":"https://opc.beizhux.com/content/3084/usage-metrics-api-adds-pull-request-review-stages","summary":"GitHub 在企业与组织仓库级 Copilot 使用指标中新增 pull_request_review_times 数组，把 PR 从准备审查到合并拆成三个阶段，分别给出中位数和 P90 耗时，帮助团队定位审查等待发生在哪里。","access_level":"member"}],"usage_policy":{"summarizable":true,"preferred_url":"https://opc.beizhux.com/content/2308/old-ocr-text-cripples-language-model-training-and-finebooks-wants-to-fix-that-at-scale","private_fields_excluded":true}}