AI觉醒星球
Awakening is here
Knowledge File / AI小生意项目库
2026-08-01 0 浏览 会员

AI编码代理可以现代化研究软件,但无法判断科学是否正确

OpenAI与学术伙伴的实地报告显示,AI编码代理能够更新和加速老旧科研软件,但大部分工作从写代码转向验证结果。尽管效率显著提升,专家指导和科学判断仍然不可或缺。

SOURCE / AI小生意项目库 MIN / 9 ACCESS / 会员 POST / 2026-08-01 22:26:28

原贴

查看原文
作者:Jonathan Kemper 来源站点:the-decoder.com 原贴时间:

原文

A field report from OpenAI and academic partners shows that coding agents can update and speed up aging research software. Much of the work, however, shifts from writing code to verifying the results. Many widely used research tools began as supporting code for a single paper. Small academic teams often wrote them without the time or resources for proper testing, maintenance, or optimization. The result is fragile software that remains critical to entire fields but requires constant repairs. A field report from OpenAI and academic partners suggests AI coding agents could help close that gap. The report documents eight case studies, mostly in biology, in which research groups used coding agents such as Codex and Claude Code. The projects range from basic maintenance and targeted optimization to full rewrites in modern programming languages. One of the simpler projects involved modernizing cyvcf2, a Python library for reading genetic data. GPT-5.5 replaced its outdated build and installation process with a modern one. The MHCflurry migration was far more involved. MHCflurry is an immunology model that predicts which targets immune cells will recognize. Claude Code and Codex alternated between the roles of developer and reviewer while porting about 10,000 lines of code from TensorFlow to PyTorch. The rustar-aligner project was more ambitious. It rebuilt STAR from scratch in Rust. STAR maps sequencing reads from cells to the corresponding locations in a genome. The original contains more than 20,000 lines of C and C++ and is no longer actively maintained, even though it remains part of many research pipelines. To check whether the rewrite behaved like the original, the team tested both tools on 10,000 short sequencing reads from yeast cells. For single-end reads, rustar-aligner produced the same result as STAR in 99.815 percent of cases. For paired-end reads, the agreement rate was 99.883 percent. The comparison covered more than the mapped location in the genome. It also included several other key fields that both programs produce for each read. Neither tool mapped any reads that the other failed to map. RustQC delivered the largest speedup by combining 15 separate quality-control tools in a single program. On a large dataset, runtime fell from 15 hours and 34 minutes to 14 minutes and 54 seconds, a speedup of more than 60 times. Another project, HelixForge, replaced a tool for generating synthetic genomic data with a version that runs on GPUs. In a test using data from one donor and a ten-million-base-pair section of the genome, HelixForge completed the full pipeline 59.6 times faster than BamSurgeon. The main compute step alone ran 98.6 times faster. Across the case studies, agents completed well-defined tasks quickly but couldn't reliably judge whether their work was scientifically correct. Even when their code contained errors, the systems often presented it with full confidence. "With coding agents, it's quite easy to go fast; for now, to go far in science, there's still a need for expert guidance, understanding, taste, and care," writes cyvcf2 developer Brent Pedersen.

中文翻译

来自OpenAI和学术合作伙伴的实地报告显示,编码代理可以更新并加速老化的研究软件。然而,大部分工作从编写代码转向了验证结果。

许多广泛使用的研究工具最初是作为单篇论文的配套代码而诞生的。小型学术团队往往在缺乏适当测试、维护或优化的时间和资源的情况下编写它们。结果是,这些脆弱软件对整个领域仍然至关重要,却需要不断修补。

OpenAI和学术合作伙伴的一份实地报告表明,AI编码代理可能有助于弥合这一差距。该报告记录了八个案例研究,主要集中在生物学领域,研究团队使用了Codex和Claude Code等编码代理。项目范围从基础维护、针对性优化到用现代编程语言全面重写。

其中一个较简单的项目涉及现代化cyvcf2,这是一个用于读取遗传数据的Python库。GPT-5.5用现代流程取代了其过时的构建和安装过程。MHCflurry的迁移则复杂得多。MHCflurry是一个免疫学模型,预测免疫细胞将识别哪些靶标。Claude Code和Codex交替担任开发者和审查者角色,将约10,000行代码从TensorFlow移植到PyTorch。

rustar-aligner项目更为宏大。它用Rust完全重写了STAR。STAR将细胞的测序读段映射到基因组中的对应位置。原版包含超过20,000行C和C++代码,且已不再积极维护,尽管它仍是许多研究流程的一部分。为了检查重写版本是否与原版行为一致,团队在来自酵母细胞的10,000个短测序读段上测试了两种工具。对于单端读段,rustar-aligner在99.815%的情况下产生了与STAR相同的结果。对于双端读段,一致性率为99.883%。比较涵盖了基因组中的映射位置,还包括了两个程序为每个读段生成的其他几个关键字段。两种工具都没有映射出对方未能映射的任何读段。

RustQC通过将15个独立的质量控制工具合并到一个程序中,实现了最大的加速。在一个大型数据集上,运行时间从15小时34分钟降至14分54秒,加速超过60倍。另一个项目HelixForge用一个可在GPU上运行的版本取代了生成合成基因组数据的工具。在使用一名捐赠者数据和基因组一段千万碱基对的测试中,HelixForge完成整个流程的速度比BamSurgeon快59.6倍。仅主要计算步骤就快了98.6倍。

在这些案例研究中,代理能快速完成定义明确的任务,但无法可靠地判断其工作是否科学正确。即使代码包含错误,系统也常常以充分的自信呈现它们。“使用编码代理,快速前进很容易;但要想在科学上走得更远,目前仍然需要专家的指导、理解、品味和细心,”cyvcf2开发者Brent Pedersen写道。

核心信息

OpenAI与学术伙伴的实地报告显示,AI编码代理能够更新和加速老旧科研软件,但大部分工作从写代码转向验证结果。尽管效率显著提升,专家指导和科学判断仍然不可或缺。

  • OpenAI与学术伙伴的实地报告显示,AI编码代理能够更新和加速老旧科研软件,但大部分工作从写代码转向验证结果。尽管效率显著提升,专家指导和科学判断仍然不可或缺。
  • 原贴提到:A field report from OpenAI and academic partners shows that coding agent
  • 来源:the-decoder.com
试看内容

成为会员查看完整内容

你已经看到了这篇内容的前置整理,剩余深度部分仅对会员开放。

详细解读 信息差价值 参考来源
成为会员查看完整内容
上一篇 AI 不断攻克未解数学难题,数学家们心情复杂 下一篇 安全研究员构建自我传播蠕虫,藏身Word文档并劫持Microsoft Copilot