{"version":"1.0","generated_at":"2026-10-02T10:01:44.771437","id":3188,"slug":"github-copilot-can-now-interact-with-desktop-apps-with-computer-use","title":"GitHub Copilot 现已可通过 computer use 操作桌面应用","summary":"GitHub Copilot 在 CLI 与 macOS/Windows 桌面应用中开放 computer use 公开预览，可代为读取界面内容并执行点击、输入、滚动、拖拽等操作，跨应用完成流程，重点覆盖没有 API、命令行或 MCP 集成的老旧与纯 GUI 软件；控制权仍归用户，操作前需批准，组织可统一禁用。","abstract":"GitHub Copilot 现已可通过 computer use 操作桌面应用 GitHub Copilot 在 CLI 与 macOS/Windows 桌面应用中开放 computer use 公开预览，可代为读取界面内容并执行点击、输入、滚动、拖拽等操作，跨应用完成流程，重点覆盖没有 API、命令行或 MCP 集成的老旧与纯 GUI 软件；控制权仍归用户，操作前需批准，组织可统一禁用。 GitHub Copilot 在 CLI 与 macOS/Windows 桌面应用中开放 computer use 公开预览，可代为读取界面内容并执行点击、输入、滚动、拖拽等操作，跨应用完成流程，重点覆盖没有 API、命令行或 MCP 集成的老旧与纯 GUI 软件；控制权仍归用户，操作前需批准，组织可统一禁用。 原贴提到：Computer use is now available in public preview in GitHub Copilot CLI an 来源：github.blog 计算机使用（computer use）现已在 GitHub Copilot CLI 以及 macOS 和 Windows 上的 GitHub Copilot 应用中进入公开预览。Copilot 可以代替你与桌面应用程序交互（例如读取可访问的应用内容和视觉上下文、点击控件、输入和编辑文本、按键、滚动、拖拽，以及跨应用导航工作流程）。这扩展了 Copilot 可以帮助自动化的任务，包括那些不提供 API、命令行界面或 MCP 集成的老旧软件和纯 GUI 软件中的工作流程。Copilot 使用 comp…","access_level":"member","access_label":"免费阅读","access_mode":"full","is_preview":false,"canonical_url":"https://opc.beizhux.com/content/3188/github-copilot-can-now-interact-with-desktop-apps-with-computer-use","html_url":"https://opc.beizhux.com/content/3188/github-copilot-can-now-interact-with-desktop-apps-with-computer-use","json_url":"https://opc.beizhux.com/content/3188/github-copilot-can-now-interact-with-desktop-apps-with-computer-use.json","published_at":"2026-10-02T03:11:26","updated_at":"2026-10-02T09:25:27","category":{"slug":"ai-skills","name":"AI技能杠杆"},"source":{"site":"github.blog","author":"Allison","url":"https://github.blog/changelog/2026-10-01-github-copilot-can-now-interact-with-desktop-apps"},"tags":["AI Agent","CLI","Computer Use","GitHub Copilot","开发者工具","桌面自动化"],"topics":[{"slug":"ai-tools","name":"AI工具","url":"https://opc.beizhux.com/topics/ai-tools","reason":"这篇内容命中「工具、自动化」等主题信号。"},{"slug":"agent-workflow","name":"Agent工作流","url":"https://opc.beizhux.com/topics/agent-workflow","reason":"这篇内容命中「Agent、工作流」等主题信号。"},{"slug":"ai-super-individual","name":"AI超级个体","url":"https://opc.beizhux.com/topics/ai-super-individual","reason":"这篇内容命中「技能」等主题信号。"}],"keywords":["AI技能杠杆","AI工具","Agent工作流","AI超级个体","工具","自动化","模型","Cursor","Claude","Agent","智能体","工作流"],"questions":[{"question":"GitHub Copilot 现已可通过 computer use 操作桌面应用主要讲什么？","answer":"GitHub Copilot 在 CLI 与 macOS/Windows 桌面应用中开放 computer use 公开预览，可代为读取界面内容并执行点击、输入、滚动、拖拽等操作，跨应用完成流程，重点覆盖没有 API、命令行或 MCP 集成的老旧与纯 GUI 软件；控制权仍归用户，操作前需批准，组织可统一禁用。"},{"question":"这篇文章最值得关注的要点是什么？","answer":"GitHub Copilot 在 CLI 与 macOS/Windows 桌面应用中开放 computer use 公开预览，可代为读取界面内容并执行点击、输入、滚动、拖拽等操作，跨应用完成流程，重点覆盖没有 API、命令行或 MCP 集…；原贴提到：Computer use is now available in public preview in GitHub Copilot CLI an；来源：github.blog"},{"question":"这篇文章和哪些AI专题相关？","answer":"它适合放在AI工具、Agent工作流、AI超级个体专题里阅读。 关联原因：这篇内容命中「工具、自动化」等主题信号。；这篇内容命中「Agent、工作流」等主题信号。；这篇内容命中「技能」等主题信号。"},{"question":"阅读这篇文章建议先理解哪些关键词？","answer":"建议先理解AI工具、工具、自动化、模型、Cursor这些关键词，再结合正文判断工具、机会或风险是否值得进入自己的工作流。"}],"terms":[{"slug":"ai-tools-term","name":"AI工具","definition":"在AI觉醒星球里，「AI工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-tools-term","path":"/glossary/ai-tools-term","json_url":"https://opc.beizhux.com/glossary/ai-tools-term.json"},{"slug":"tools","name":"工具","definition":"在AI觉醒星球里，「工具」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/tools","path":"/glossary/tools","json_url":"https://opc.beizhux.com/glossary/tools.json"},{"slug":"automation","name":"自动化","definition":"在AI觉醒星球里，「自动化」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/automation","path":"/glossary/automation","json_url":"https://opc.beizhux.com/glossary/automation.json"},{"slug":"ai-model","name":"模型","definition":"在AI觉醒星球里，「模型」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/ai-model","path":"/glossary/ai-model","json_url":"https://opc.beizhux.com/glossary/ai-model.json"},{"slug":"cursor","name":"Cursor","definition":"在AI觉醒星球里，「Cursor」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/cursor","path":"/glossary/cursor","json_url":"https://opc.beizhux.com/glossary/cursor.json"},{"slug":"claude","name":"Claude","definition":"在AI觉醒星球里，「Claude」属于「AI工具」方向。围绕AI工具、模型能力、自动化流程和真实使用场景做整理，优先关注能提升效率、降低成本和创造新交付的工具。 不只看工具热度，更看它能不能进入真实流程。","topic_slug":"ai-tools","topic_name":"AI工具","topic_title":"AI工具：模型、插件、自动化与实战场景","topic_url":"https://opc.beizhux.com/topics/ai-tools","topic_path":"/topics/ai-tools","url":"https://opc.beizhux.com/glossary/claude","path":"/glossary/claude","json_url":"https://opc.beizhux.com/glossary/claude.json"},{"slug":"agent","name":"Agent","definition":"在AI觉醒星球里，「Agent」属于「Agent工作流」方向。聚合Agent、AI编程、Claude Code、Cursor、工作流自动化等内容，帮助你把智能体能力落到真实任务链路。 把智能体当成任务系统，而不是聊天窗口。","topic_slug":"agent-workflow","topic_name":"Agent工作流","topic_title":"Agent工作流：智能体、AI编程与自动化协作","topic_url":"https://opc.beizhux.com/topics/agent-workflow","topic_path":"/topics/agent-workflow","url":"https://opc.beizhux.com/glossary/agent","path":"/glossary/agent","json_url":"https://opc.beizhux.com/glossary/agent.json"},{"slug":"ai-agent","name":"智能体","definition":"在AI觉醒星球里，「智能体」属于「Agent工作流」方向。聚合Agent、AI编程、Claude Code、Cursor、工作流自动化等内容，帮助你把智能体能力落到真实任务链路。 把智能体当成任务系统，而不是聊天窗口。","topic_slug":"agent-workflow","topic_name":"Agent工作流","topic_title":"Agent工作流：智能体、AI编程与自动化协作","topic_url":"https://opc.beizhux.com/topics/agent-workflow","topic_path":"/topics/agent-workflow","url":"https://opc.beizhux.com/glossary/ai-agent","path":"/glossary/ai-agent","json_url":"https://opc.beizhux.com/glossary/ai-agent.json"}],"preview_hidden_sections":[],"related_items":[{"id":3179,"title":"从想法到可在 ModRetro 上玩的游戏：OpenAI Devs 对话 @Casey 谈创造力未来","url":"https://opc.beizhux.com/content/3179/from-an-idea-to-a-game-you-can-play-on-modretro-we-caught-up-with","summary":"OpenAI Devs 在 X 上发布内容，称从想法到一款可在 @modretro 上玩的游戏，并与 @Casey 对话，讨论创造力的未来，附原始访谈链接。","access_level":"member"},{"id":3190,"title":"GitHub Copilot in VS Code 2026年9月发布","url":"https://opc.beizhux.com/content/3190/github-copilot-in-vs-code-september-2026-releases","summary":"2026年9月发布的 VS Code v1.136 至 v1.140 更新聚焦代理驱动开发，从实现到拉取请求合并全流程。新增自动化任务、代理合并、HydraFusion 模型协调、从代理会话创建 PR 等能力，多数功能处于预览或研究预览阶段。","access_level":"member"},{"id":3156,"title":"OpenRouter 教程：提示词或模型变更后如何对 AI Agent 做回归测试","url":"https://opc.beizhux.com/content/3156/openrouter-ai-agent","summary":"OpenRouter 发布 AI Agent 回归测试教程，建议在提示词、模型、工具定义或检索设置变更后，重跑锁定的用例集并对照书面行为契约检查，同时固定具体模型 slug，以便做模型切换对比。","access_level":"member"}],"usage_policy":{"summarizable":true,"preferred_url":"https://opc.beizhux.com/content/3188/github-copilot-can-now-interact-with-desktop-apps-with-computer-use","private_fields_excluded":true}}