{"version":"1.0","generated_at":"2026-10-06T01:48:51.565961","id":1144,"slug":"new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent","title":"趋势解读：New open-source voice model listens nonstop and decides，讨论数据集与基础模型","summary":"“音频交互”AI模型处理连续音频流，结合对话、翻译、转录和声音识别于单一系统。它将音频分解为0.4秒片段，通过特殊标记决定静音或响应。使用30.2万小时人工数据集训练，并行处理听与说，最小化响应等待时间，在主动噪声检测中击败Gemini 3 Flash。研究人员希望缩小音频语音模型与真实听众的差距。","abstract":"趋势解读：New open-source voice model listens nonstop and decides，讨论数据集与基础模型 “音频交互”AI模型处理连续音频流，结合对话、翻译、转录和声音识别于单一系统。它将音频分解为0.4秒片段，通过特殊标记决定静音或响应。使用30.2万小时人工数据集训练，并行处理听与说，最小化响应等待时间，在主动噪声检测中击败Gemini 3 Flash。研究人员希望缩小音频语音模型与真实听众的差距。 0.4秒粒度自主决策，实现连续流式音频交互。 30.2万小时人工数据集解决长序列稀疏响应问题。 多任务并行，单模型集成对话、翻译、转录、声音识别。 公开数据集StreamAudio-2M和模型权重，学术与商业可用。 通过回溯提问对抗长序列记忆遗忘。 “音频交互”人工智能模型处理连续的音频流，并将对话、翻译、转录和声音识别等任务结合在一个系统中。为此，它将音频流分解为0.4秒的片段，并在每个片段之后通过特殊令牌决定是否应该保持静音或生成响应。该模型使用302,000小时音频的人工数据集进行训练，并行处理听力和口语。这最大限度地减少了响应的等待时间，并使系统在主动噪声检测测试中击败Gemini 3 Flash等型号。研究人员希望缩小当今的音频语音模型与真实听众之间的差距。他们的系统可以同时处理对话、翻译和声音识别。 这是什么信号 这是一项来自中国、香港和新加坡研究团队的开源音频交互模型，实现了连续音频流处理与多任务并行（对话、翻译、转录、声音识别），并配套构建了大规模人工数据集StreamAudio-2M。该模型在0.4秒的粒度上自主决定何时…","access_level":"public","access_label":"公开","access_mode":"full","is_preview":false,"canonical_url":"https://opc.beizhux.com/content/1144/new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent","html_url":"https://opc.beizhux.com/content/1144/new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent","json_url":"https://opc.beizhux.com/content/1144/new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent.json","published_at":"2026-06-06T18:50:21","updated_at":"2026-10-04T23:36:49","category":{"slug":"hotspots","name":"全球热点解读"},"source":{"site":"the-decoder.com","author":"Jonathan Kemper","url":"https://the-decoder.com/new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent/"},"tags":["AI","StreamAudio-2M","The Decoder","多任务学习","开源模型","研究","语音AI","音频交互"],"topics":[{"slug":"ai-daily","name":"AI日报","url":"https://opc.beizhux.com/topics/ai-daily","reason":"这篇内容命中「热点解读」等主题信号。"},{"slug":"ai-tools","name":"AI工具","url":"https://opc.beizhux.com/topics/ai-tools","reason":"这篇内容命中「模型」等主题信号。"},{"slug":"ai-super-individual","name":"AI超级个体","url":"https://opc.beizhux.com/topics/ai-super-individual","reason":"这篇内容命中「学习」等主题信号。"}],"keywords":["全球热点解读","AI日报","AI工具","AI超级个体","每日AI日报","AI信号","热点解读","BuilderPulse","工具","自动化","模型","Cursor"],"questions":[{"question":"趋势解读：New open-source voice model listens nonstop and decides，讨论数据集与基础模型主要讲什么？","answer":"“音频交互”AI模型处理连续音频流，结合对话、翻译、转录和声音识别于单一系统。它将音频分解为0.4秒片段，通过特殊标记决定静音或响应。使用30.2万小时人工数据集训练，并行处理听与说，最小化响应等待时间，在主动噪声检测中击败Gemini 3 Flash。研究人员希望缩小音频语音模型与真实听众的差距。"},{"question":"这篇文章最值得关注的要点是什么？","answer":"“音频交互”AI模型处理连续音频流，结合对话、翻译、转录和声音识别于单一系统。它将音频分解为0.4秒片段，通过特殊标记决定静音或响应。使用30.2万小时人工数据集训练，并行处理听与说，最小化响应等待时间，在主动噪声检测中击败Gemini…；0.4秒粒度自主决策，实现连续流式音频交互。；30.2万小时人工数据集解决长序列稀疏响应问题。；多任务并行，单模型集成对话、翻译、转录、声音识别。"},{"question":"这篇文章和哪些AI专题相关？","answer":"它适合放在AI日报、AI工具、AI超级个体专题里阅读。 关联原因：这篇内容命中「热点解读」等主题信号。；这篇内容命中「模型」等主题信号。；这篇内容命中「学习」等主题信号。"},{"question":"阅读这篇文章建议先理解哪些关键词？","answer":"建议先理解AI日报、每日AI日报、AI信号、热点解读、BuilderPulse这些关键词，再结合正文判断工具、机会或风险是否值得进入自己的工作流。"}],"terms":[{"slug":"ai-daily-term","name":"AI日报","definition":"在AI觉醒星球里，「AI日报」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-daily-term","path":"/glossary/ai-daily-term","json_url":"https://opc.beizhux.com/glossary/ai-daily-term.json"},{"slug":"daily-ai-briefing","name":"每日AI日报","definition":"在AI觉醒星球里，「每日AI日报」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/daily-ai-briefing","path":"/glossary/daily-ai-briefing","json_url":"https://opc.beizhux.com/glossary/daily-ai-briefing.json"},{"slug":"ai-signal","name":"AI信号","definition":"在AI觉醒星球里，「AI信号」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-signal","path":"/glossary/ai-signal","json_url":"https://opc.beizhux.com/glossary/ai-signal.json"},{"slug":"ai-news-analysis","name":"热点解读","definition":"在AI觉醒星球里，「热点解读」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/ai-news-analysis","path":"/glossary/ai-news-analysis","json_url":"https://opc.beizhux.com/glossary/ai-news-analysis.json"},{"slug":"builderpulse","name":"BuilderPulse","definition":"在AI觉醒星球里，「BuilderPulse」属于「AI日报」方向。持续整理每日AI日报、模型更新、工具变化和行业信号，帮你快速判断哪些信息值得收藏、验证和行动。 每天先看趋势，再决定今天该试什么。","topic_slug":"ai-daily","topic_name":"AI日报","topic_title":"AI日报：每日AI信号、工具动态与行动判断","topic_url":"https://opc.beizhux.com/topics/ai-daily","topic_path":"/topics/ai-daily","url":"https://opc.beizhux.com/glossary/builderpulse","path":"/glossary/builderpulse","json_url":"https://opc.beizhux.com/glossary/builderpulse.json"},{"slug":"ai-tools-term","name":"AI工具","definition":"在AI觉醒星球里，「AI工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-tools-term","path":"/glossary/ai-tools-term","json_url":"https://opc.beizhux.com/glossary/ai-tools-term.json"},{"slug":"tools","name":"工具","definition":"在AI觉醒星球里，「工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/tools","path":"/glossary/tools","json_url":"https://opc.beizhux.com/glossary/tools.json"},{"slug":"automation","name":"自动化","definition":"在AI觉醒星球里，「自动化」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/automation","path":"/glossary/automation","json_url":"https://opc.beizhux.com/glossary/automation.json"}],"preview_hidden_sections":[],"related_items":[{"id":3249,"title":"【必读】每日AI日报 2026-10-05","url":"https://opc.beizhux.com/content/3249/aihot-daily-2026-10-05","summary":"AIHOT 每日 AI 日报：AIHOT 日报参考","access_level":"public"},{"id":3250,"title":"PromptArmor 披露 Databricks Genie 恶意 Skill 可绕过四类控制实施钓鱼与数据外泄","url":"https://opc.beizhux.com/content/3250/promptarmor-databricks-genie-skill","summary":"PromptArmor 披露 Databricks Genie Code 可被恶意 Skill 利用：Skill 代码将数据嵌入聊天渲染的 HTML 显示，渲染时通过用户浏览器发起网络请求外泄数据，并弹出钓鱼界面索取凭据。","access_level":"public"},{"id":3237,"title":"OpenAI GPT-6 Sol Codex 约29.4万字符系统提示词遭泄露","url":"https://opc.beizhux.com/content/3237/openai-gpt-6-sol-codex-29-4","summary":"爆料者 @elder_plinius 声称已提取 OpenAI GPT-6 Sol Codex 的完整系统提示词与工具定义，规模约29.4万字符、1902行，并已发布到 GitHub。该消息目前为单方爆料，未经 OpenAI 确认，但因其体量与指向的模型代号而引发关注。","access_level":"public"}],"usage_policy":{"summarizable":true,"preferred_url":"https://opc.beizhux.com/content/1144/new-open-source-voice-model-listens-nonstop-and-decides-every-0-4-seconds-whether-to-speak-or-stay-silent","private_fields_excluded":true}}