AI觉醒星球
Awakening is here
Knowledge File / 全球热点解读
2026-05-12 4 浏览 公开

趋势解读:Thinking Machines Lab ships its first model and,提升开发者接入体验

Thinking Machines Lab发布首个AI模型,采用200毫秒微转向处理音视频文本,实现流畅实时对话,优于GPT-Realtime-2等。该模型与后台推理模型配合,但面临核心员工离职压力。

SOURCE / 全球热点解读 MIN / 9 ACCESS / 公开 POST / 2026-05-12 21:16:03

原贴

查看原文
作者:Maximilian Schreiner 来源站点:the-decoder.com 原贴时间:

原文

Thinking Machines Lab, founded by ex-OpenAI CTO Mira Murati, has released its first AI model that processes audio, video, and text in 200-millisecond chunks, replacing rigid turn-taking with fluid, real-time conversation. The model outperforms OpenAI's GPT-Realtime-2 and Google's Gemini Live on interaction quality and latency benchmarks, pairing a fast interaction model with a background reasoning model. Despite the technical promise, the startup still faces pressure, as several key employees have recently left the company. Thinking Machines Lab has released a research preview of its first AI model, designed to break voice AI out of the traditional question-and-answer pattern. The model processes audio, video, and text in parallel 200-millisecond chunks, and the startup claims it beats OpenAI's GPT-Realtime-2 and Google's Gemini Live on interaction quality. Thinking Machines Lab has published a research preview of what it calls Interaction Models , AI models that handle interaction natively rather than through external scaffolding. The core idea is that interactivity should scale alongside intelligence, not get treated as an afterthought. Today's real-time systems like GPT-Realtime or Gemini Live continuously take in audio, but the actual language model never sees it directly. According to Thinking Machines, a "harness" of separate components sits in front of the model, including things like a voice activity detector that decides when a speaker's turn is over. Only then does the finished utterance get handed to the model, which generates a complete response. While it's talking, its perception freezes, receiving no new information until it finishes or gets interrupted. Ad These components are far less intelligent than the model itself. That means behaviors that define real conversation simply don't work, according to Thinking Machines: proactively jumping in ("interrupt me if I say something wrong"), reacting to visual cues ("tell me when I've written a bug"), or speaking simultaneously, which would be useful for something like live translation. Citing Sutton's "Bitter Lesson," the lab argues that these hand-crafted systems will eventually be outpaced by the advance of general capabilities. Ad DEC_D_Incontent-1 Thinking Machines' Interaction Models replace the harness with a model that processes the audio and video stream directly rather than receiving pre-segmented utterances. The approach resembles full-duplex models like Moshi or Nemotron VoiceChat , which work in a similarly interleaved fashion but are smaller-scale models focused on latency rather than intelligence benchmarks. The real break from existing architectures is what the team calls time-aligned micro-turns. The model continuously processes 200 milliseconds of input and generates 200 milliseconds of output, with both token streams running in an interleaved fashion. Input and output no longer happen sequentially. Instead, they share the same clock cycle. Ad This eliminates artificial turn boundaries, letting the model decide on its own whether to stay silent, interject, or speak alongside the user. Audio and images aren't preprocessed through large, standalone encoders but are fed directly into the transformer with minimal preprocessing. That saves latency, though it could also limit the model's ability to pick up fine visual details like text. The real-time model has another challenge, though. If you need to respond every 200 milliseconds, you can't simultaneously spend minutes reasoning or searching the web. Thinking Machines solves this by pairing the interaction model with a second, asynchronous background model that handles longer tasks like reasoning, tool use, and research. Ad DEC_D_Incontent-2 Both models share the same conversation context. The interaction model delegates tasks while keeping the conversation going, then weaves results from the background model into the conversation as they arrive, at a moment appropriate to what the user is curr

中文翻译

由前 OpenAI 首席技术官 Mira Murati 创立的 Thinking Machines Lab 发布了其第一个 AI 模型,该模型可以以 200 毫秒的速度处理音频、视频和文本,用流畅的实时对话取代僵化的轮流对话。该模型在交互质量和延迟基准方面优于 OpenAI 的 GPT-Realtime-2 和 Google 的 Gemini Live,将快速交互模型与后台推理模型配对。尽管有技术承诺,但这家初创公司仍然面临压力,因为几名关键员工最近离开了公司。Thinking Machines Lab 发布了其第一个 AI 模型的研究预览,旨在将语音 AI 打破传统的问答模式。该模型以 200 毫秒的时间块并行处理音频、视频和文本,该初创公司声称它在交互质量上击败了 OpenAI 的 GPT-Realtime-2 和谷歌的 Gemini Live。Thinking Machines Lab 发布了一份名为“交互模型”的研究预览,即本地处理交互而不是通过外部脚手架处理交互的人工智能模型。核心思想是交互性应该与智能一起扩展,而不是被视为事后的想法。当今的实时系统(例如 GPT-Realtime 或 Gemini Live)不断接收音频,但实际的语言模型从未直接看到它。根据 Thinking Machines 的说法,模型前面有一个由独立组件组成的“线束”,其中包括语音活动检测器等,可以决定发言者的发言何时结束。只有这样,完成的话语才会被传递给模型,模型会生成完整的响应。当它说话时,它的感知会冻结,在结束或被打断之前不会接收到新信息。这些组件的智能程度远不如模型本身。根据Thinking Machines的说法,这意味着定义真实对话的行为根本行不通:主动插话(“如果我说错了就打断我”),对视觉提示做出反应(“当我写了一个错误时告诉我”),或者同时说话,这对于实时翻译之类的事情很有用。该实验室引用萨顿的“惨痛教训”,认为这些手工制作的系统最终将被通用能力的进步所超越。Ad DEC_D_Incontent-1 Thinking Machines 的交互模型将线束替换为直接处理音频和视频流而不是接收预先分段的话语的模型。该方法类似于 Moshi 或 Nemotron VoiceChat 等全双工模型,它们以类似的交错方式工作,但规模较小,专注于延迟而不是智能基准。与现有架构的真正突破是团队所说的时间对齐微转向。该模型连续处理 200 毫秒的输入并生成 200 毫秒的输出,两个令牌流以交错的方式运行。输入和输出不再按顺序发生。相反,它们共享相同的时钟周期。这消除了人为的转弯边界,让模型自行决定是否保持沉默、插话或与用户一起说话。音频和图像不通过大型独立编码器进行预处理,而是通过最少的预处理直接输入到变压器中。这可以节省延迟,但也可能限制模型拾取文本等精细视觉细节的能力。不过,实时模型还有另一个挑战。如果您需要每 200 毫秒响应一次,您就无法同时花费几分钟进行推理或搜索网络。 Thinking Machines 通过将交互模型与第二个异步后台模型配对来解决这个问题,该模型处理推理、工具使用和研究等较长的任务。Ad DEC_D_Incontent-2 两个模型共享相同的对话上下文。交互模型在保持对话继续的同时委派任务,然后在结果到达时将后台模型的结果编织到对话中,并在适合用户当前活动的时刻。

核心信息

Thinking Machines Lab发布首个AI模型,采用200毫秒微转向处理音视频文本,实现流畅实时对话,优于GPT-Realtime-2等。该模型与后台推理模型配合,但面临核心员工离职压力。

  • 发布首个交互模型,采用200ms微转向
  • 直接处理音视频流,无需外部线束
  • 交互质量优于GPT-Realtime-2和Gemini Live
  • 面临核心员工离职压力
  • 交互与推理分离,双模型协作

详细解读

这是什么信号:Thinking Machines Lab发布了其首个交互模型,核心突破在于将交互性原生集成到AI模型中,而非通过外部线束实现。这挑战了当前主流语音AI(如GPT-Realtime、Gemini Live)的架构,引入时间对齐微转向机制,使模型能在200毫秒内并行处理音视频文本,实现类人实时对话。该模型在交互质量和延迟上超越现有对手,但团队核心员工离职带来不确定性。

为什么重要:这标志着语音交互从“轮问式”向“流式”的关键转变。传统系统将交互视为后处理任务,而新模型将交互与智能扩展同步,可能重塑语音助手、实时翻译、客服机器人等场景的用户体验。如果成功,将推动AI交互进入更自然、低延迟的新阶段。

对谁有价值:对AI开发者而言,提供了新架构参考;对语音产品公司,需评估是否采用或跟进;对实时翻译、会议记录等应用场景,可能获得更流畅的交互体验;对投资机构,关注这家初创公司的技术潜力与团队稳定性。

可以怎么行动:开发者可研究其研究预览,尝试集成到个人项目中;产品经理可评估在客服、协作工具中测试流式交互;企业可关注其后续API发布,考虑替换现有僵化语音接口;同时,建议持续跟踪模型稳定性、成本及团队变动。

风险或限制:模型目前仅为研究预览,尚未商业化;员工离职可能影响进展;微转向机制可能限制复杂视觉细节处理;双模型配对增加系统复杂度;与OpenAI等巨头的竞争激烈,市场接受度存疑。

信息差价值

信息差价值:本文揭示了主流语音AI(如GPT-Realtime)在交互架构上的根本缺陷——将交互视为事后处理,而Thinking Machines Lab提出的原生交互模型提供了破局思路。这一技术细节在公开报道中较少深入,尤其是其对“萨顿惨痛教训”的引用,暗示手工线束终将被通用能力取代,具有前瞻性。

业务启发:对于AI产品公司,应重新思考交互设计:自然对话需要模型自主判断插话、沉默或并行回应,而非依赖外部规则。可探索将类似机制嵌入现有语音产品,提升用户粘性。同时,双模型分工(交互+推理)为复杂任务提供了分层解决方案,值得在知识密集型场景(如法律咨询、医疗问诊)中尝试。

可沉淀动作:1. 跟踪Thinking Machines Lab的研究进展和API开放计划,准备技术适配方案;2. 在其开源或demo可用时,立即进行压力测试和场景映射,对比现有方案在延迟和自然度上的差异;3. 建立内部实验性项目,在非关键流程中试用流式交互,积累数据;4. 关注团队动态,评估长期合作或人才吸纳可能性。

参考来源

上一篇 材料科学AI多任务模型突破 下一篇 趋势解读:Sam Altman's personal investments face political scrutiny ahead,提升开发者接入体验