{"rewrite":{"id":"r_4cf3962997e79d87c8c8e9d8","clusterId":"c_fa9389d0e524a0e72065dd63","slug":"holodesktop-cli-lets-ai-agents-see-and-operate-a-pc-screen","model":"deepseek-v4-flash","headline":"HoloDesktop CLI Lets AI Agents See and Operate a PC Screen","summary":"H Company announced HoloDesktop CLI, a client that lets AI agents see the screen and perform mouse and keyboard operations. It integrates with existing agents like Claude Code and Cursor, and can handle GUI tasks such as testing web app features. The tool supports MCP, ACP, and A2A protocols, and offers both cloud API and self-hosted local inference.","whyItMatters":"HoloDesktop CLI bridges the gap between code-writing AI agents and the GUI tasks that still require human eyes and hands, potentially automating full workflows end to end.","webCardHtml":"\u003cp\u003eH Company released HoloDesktop CLI on Thursday, a client that gives AI agents the ability to see a PC screen and perform mouse clicks and keyboard input. The tool runs the company\u0026#39;s H Agent, which can operate any application by looking at the screen, even those without a dedicated API. HoloDesktop CLI supports the MCP, ACP, and A2A protocols, allowing it to work alongside agents such as Claude Code, Cursor, and Codex. In one example, Claude Code writes new code, then hands testing to HoloDesktop CLI, which finds bugs on the screen, Claude Code fixes them, and HoloDesktop CLI verifies again. Users can choose between H Company\u0026#39;s cloud API for convenience or a self-hosted local mode that keeps screenshots and inputs on the user\u0026#39;s hardware. Safety features include an emergency kill switch triggered by pressing Esc twice quickly. The CLI and protocol integration code are open source under Apache 2.0, while the agent runtime binary remains closed source under H Company\u0026#39;s terms. H Company plans to add a background mode and a native app for daily workflows, as well as a cloud-based agent that can run multiple instances across PCs.\u003c/p\u003e","blueskyPost":"HoloDesktop CLI gives existing AI agents eyes and hands for GUI tasks, bridging the gap between LLM reasoning and direct screen interaction without API access.","twitterPost":"HoloDesktop CLI gives AI agents screen vision and mouse control, enabling GUI automation for apps without APIs.","threadsPost":"HoloDesktop CLI lets agents like Claude Code and Cursor see and operate a PC screen directly, handling GUI tasks such as web app testing without any API integration. It supports MCP, ACP, and A2A protocols, and can run via cloud API or local inference.","newsletterBlurb":"H Company announced HoloDesktop CLI, a client that lets AI agents see the screen and perform mouse and keyboard operations. It integrates with existing agents like Claude Code and Cursor, and can handle GUI tasks such as testing web app features. The tool supports MCP, ACP, and A2A protocols, and offers both cloud API and self-hosted local inference.","attributionJson":"[{\"source\":\"GIGAZINE\",\"url\":\"https://gigazine.net/news/20260625-holodesktop-cli/\",\"title\":\"HoloDesktop CLI arrives, automating PC operations in collaboration with existing AI agents, even apps without APIs can be operated by looking at the screen\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":4233,"outputTokens":663,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1782596669,"createdAt":"2026-06-27T21:37:47.000Z","publishedAt":"2026-06-27T21:40:24.000Z","updatedAt":"2026-06-27T21:40:24.000Z"},"cluster":{"id":"c_fa9389d0e524a0e72065dd63","canonicalTitle":"既存AIエージェントと連携してPC操作を自動化、APIなしのアプリも画面を見て操作する「HoloDesktop CLI」が登場","representativeArticleId":"a_47d36c6ee3f4d623ca0320a6","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[],\"studios\":[],\"people\":[],\"type\":\"announcement\",\"domain\":\"other\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-06-25T07:30:00.000Z","lastSeenAt":"2026-06-25T07:30:00.000Z","updatedAt":"2026-06-27T21:40:25.000Z"},"attribution":[{"source":"GIGAZINE","url":"https://gigazine.net/news/20260625-holodesktop-cli/","title":"既存AIエージェントと連携してPC操作を自動化、APIなしのアプリも画面を見て操作する「HoloDesktop CLI」が登場"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":[],"studios":[],"people":[],"type":"announcement","domain":"other","is_roundup":false},"keyFacts":["H Company released HoloDesktop CLI on Thursday, a client that lets AI agents see a PC screen and perform mouse clicks and keyboard input.","The tool supports MCP, ACP, and A2A protocols, integrating with agents like Claude Code, Cursor, and Codex.","Users can choose between H Company's cloud API or a self-hosted local mode that keeps screenshots and inputs on the user's hardware.","Safety features include an emergency kill switch triggered by pressing Esc twice quickly.","The CLI and protocol integration code are open source under Apache 2.0, while the agent runtime binary remains closed source."]}