{"rewrite":{"id":"r_d17e773c77839ab40483cb22","clusterId":"c_c65672aa1a660bb42c198466","slug":"mihoyo-publishes-gamer-an-ai-agent-that-plays-games-from-the-screen","model":"deepseek-v4-1-flash","headline":"miHoYo Publishes Gamer, an AI Agent That Plays Games From the Screen","summary":"miHoYo's Honkai AI R\u0026D Team published a project page and paper on November 13 for Gamer, an AI model that reads the game screen and operates a keyboard and mouse the way a human player would. The team built Gamer on Alibaba's publicly released Qwen3-VL (8B) model, trained it on tens of thousands of hours of play records, added annotations explaining why each operation was performed, then ran reinforcement learning so the agent could learn goal-directed actions by trial and error. During play Gamer uses no internal game data and works only from what appears on screen. Evaluation used Honkai: Star Rail plus ViZDoom, a research environment based on DOOM. In Star Rail, Gamer reached an 80.0 percent intermediate goal achievement rate on the side quest Slow-Witted Thief, Part 1 and 83.6 percent on Fierce Animals, and averaged a 49.7 percent success rate across seven mini-games it had not trained on.","whyItMatters":"The team names automated quest-progress checks and regression testing after updates as intended uses, which puts Gamer closer to a development tool than to a player-facing product.","webCardHtml":"\u003cp\u003eGame Spark and Inside both describe the team as positioning Gamer as a \u0026#34;test player\u0026#34; for game development. The intended uses are checking that quests progress normally and regression testing existing content after updates.\u003c/p\u003e\n\u003cp\u003eThe project page includes video of Gamer in Honkai: Star Rail\u0026#39;s main story: walking toward destinations, following the character leading the way, and clearing battles with enemies and boss fights. Mini-game footage shows it clearing five types of mini-games, from ones requiring logical thinking to ones requiring timing and precision of operation.\u003c/p\u003e\n\u003cp\u003eOn the same seven mini-games, GPT-6.1-Sol scored 17.1 percent against Gamer\u0026#39;s 49.7 percent average. The paper reports results on high-performance data-center GPUs such as the H200, so personal use is considered difficult. A GitHub page has been published, with the inference engine slated for release soon.\u003c/p\u003e\n\u003cp\u003eThe paper is titled \u0026#34;Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agent\u0026#34; and was published on arXiv.\u003c/p\u003e","blueskyPost":"Gamer scored 49.7 percent across seven Honkai: Star Rail mini-games it never trained on. miHoYo's agent reads only the screen, so that number measures how far screen-only play generalizes past the quests it learned.","twitterPost":"miHoYo's Gamer averaged 49.7 percent on seven Honkai: Star Rail mini-games it never trained on. Screen-only play generalizes unevenly.","threadsPost":"miHoYo's Gamer hit 80.0 and 83.6 percent on two Honkai: Star Rail side quests, then averaged 49.7 percent across seven mini-games it had not trained on. The drop is the useful figure: an agent working only from the screen carries trained habits into unfamiliar goals.","newsletterBlurb":"miHoYo published a paper on Gamer, an AI agent that reads the screen and drives a keyboard and mouse. It was evaluated on Honkai: Star Rail side quests and mini-games, and the team pitches it as a test player for development.","attributionJson":"[{\"source\":\"Denfaminicogamer\",\"url\":\"https://news.denfaminicogamer.jp/news/2611172m\",\"title\":\"miHoYo Developing \\\"Gamer,\\\" an AI Model That Plays Games With Keyboard and Mouse Input Like a Human; Footage of It Playing \\\"Honkai: Star Rail\\\" Released\"},{\"source\":\"Game Spark\",\"url\":\"http://www.gamespark.jp/article/2026/11/17/174972.html\",\"title\":\"miHoYo Publishes Research on AI That Plays Games; AI Sees Game Screen and Operates Keyboard \\u0026 Mouse - Tested on 'Honkai: Star Rail' and Others; 'DOOM'-Based Environment Also Used, as Expected\"},{\"source\":\"Inside\",\"url\":\"https://www.inside-games.jp/article/2026/11/17/191126.html\",\"title\":\"AI Sees the Game Screen and Plays!? miHoYo Publishes Research Results on General-Purpose AI Agent \\\"Gamer\\\"\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":15232,"outputTokens":1248,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1794912013,"createdAt":"2026-11-17T10:34:48.000Z","publishedAt":"2026-11-17T10:39:12.000Z","updatedAt":"2026-11-17T10:39:12.000Z"},"cluster":{"id":"c_c65672aa1a660bb42c198466","canonicalTitle":"miHoYoが人間のようにキーボードとマウス入力でゲームを操作するAIモデル「Gamer」を開発中。『崩壊：スターレイル』をプレイする様子が公開","representativeArticleId":"a_893adc731f0596f5465ca64c","sourceCount":4,"writtenSourceCount":3,"writeAttempts":0,"isSolo":false,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[\"Honkai: Star Rail\"],\"studios\":[\"miHoYo\"],\"people\":[],\"type\":\"news\",\"domain\":\"games\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-11-17T08:50:32.000Z","lastSeenAt":"2026-11-17T11:00:03.000Z","updatedAt":"2026-11-17T11:06:46.000Z"},"attribution":[{"source":"Denfaminicogamer","url":"https://news.denfaminicogamer.jp/news/2611172m","title":"miHoYoが人間のようにキーボードとマウス入力でゲームを操作するAIモデル「Gamer」を開発中。『崩壊：スターレイル』をプレイする様子が公開"},{"source":"GameBusiness.jp","url":"https://www.gamebusiness.jp/article/2026/11/17/28722.html","title":"miHoYo、ゲームを遊ぶAIの研究成果を公開。AIがゲーム画面を見てキーボード＆マウスを操作―『崩壊：スターレイル』などで検証。やっぱり『DOOM』系環境も使われる"},{"source":"Inside","url":"https://www.inside-games.jp/article/2026/11/17/191126.html","title":"AIがゲーム画面を見て操作!? miHoYo、汎用AIエージェント「Gamer」の研究成果を公開"},{"source":"Game Spark","url":"http://www.gamespark.jp/article/2026/11/17/174972.html","title":"miHoYo、ゲームを遊ぶAIの研究成果を公開。AIがゲーム画面を見てキーボード＆マウスを操作―『崩壊：スターレイル』などで検証。やっぱり『DOOM』系環境も使われる"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":["Honkai: Star Rail"],"studios":["miHoYo"],"people":[],"type":"news","domain":"games","is_roundup":false},"keyFacts":["miHoYo's Honkai AI R\u0026D Team published a project page and paper on Gamer on November 13.","Gamer is built on Alibaba's Qwen3-VL (8B) model and trained on tens of thousands of hours of play records.","Gamer reached an 80.0 percent intermediate goal achievement rate on the Honkai: Star Rail side quest Slow-Witted Thief, Part 1 and 83.6 percent on Fierce Animals.","Gamer averaged a 49.7 percent success rate across seven Honkai: Star Rail mini-games, against 17.1 percent for GPT-6.1-Sol in the same evaluation.","The Gamer paper reports results using data-center GPUs such as the H200, and the inference engine is slated for release soon."],"pageLinks":{"healthSlugs":["honkai-star-rail","mihoyo"],"storySlugs":[],"entities":[{"slug":"honkai-star-rail","supported":10,"disputed":0,"contradicted":0,"unverified":39,"overall":"green","story_count":43,"has_dossier":false},{"slug":"mihoyo","supported":0,"disputed":0,"contradicted":0,"unverified":7,"overall":"unverified","story_count":10,"has_dossier":true}],"stories":[],"entitiesOk":true,"storiesOk":true}}
