{"rewrite":{"id":"r_b0a70e5af4673e63831a31f7","clusterId":"c_e93d29e53f0003d9e9057508","slug":"deepseek-v4-flash-stumbles-on-real-agent-tasks-as-prices-surge","model":"deepseek-v4-flash:free","headline":"DeepSeek V4 Flash Stumbles on Real Agent Tasks as Prices Surge","summary":"DeepSeek's V4 Flash model, popular for its low cost and high benchmark scores, is facing criticism after third-party tests showed it struggling on real-world agent tasks. Composio ran 30 difficult multi-step workflows across four harnesses, with only 6 fully succeeding. The company also raised API prices on August 6, 2026, citing unprecedented demand.","whyItMatters":"The gap between V4 Flash's benchmark scores and its real-world agent performance, combined with the price increase, challenges the model's value proposition in enterprise environments where orchestration matters as much as raw capability.","webCardHtml":"\u003cp\u003eDeepSeek\u0026#39;s V4 Flash has been a hit for its low price and strong benchmark results, but third-party testing suggests the model may not live up to its scores when put to work on real tasks. Composio, an AI agent platform, ran 30 difficult multi-step workflows across four agent harnesses, using tools like Gmail, GitHub, Slack, and Google Sheets. Out of 240 total runs, 129 passed, and only 6 of the 30 workflows succeeded across every harness.\u003c/p\u003e\u003cp\u003eThe cost per successful task stayed under $0.20 even on the priciest setup, so efficiency remains decent. But Composio notes that DeepSeek\u0026#39;s August 6 API price increase could change that calculus. The company has not explained the hike, though some attribute it to a surge in demand that has also slowed inference speeds.\u003c/p\u003e","blueskyPost":"DeepSeek V4 Flash's benchmark scores do not translate to agent reliability. Composio's 30-task test, with only 6 full successes, exposes a gap that pricing hikes do not address.","twitterPost":"DeepSeek V4 Flash's benchmarks overstate agent reliability. Composio's 30-task test: only 6 full successes.","threadsPost":"DeepSeek V4 Flash's benchmark scores do not predict real agent performance. Composio ran 30 multi-step workflows across four harnesses, and only 6 fully succeeded. The model's popularity rested on cost and scores; the test suggests orchestration is the weak point, and the price hike adds tension.","newsletterBlurb":"DeepSeek's V4 Flash has been a budget favorite, but third-party tests show it struggling on real agent tasks, with only 6 of 30 workflows succeeding across harnesses. The company's recent API price increase could further erode its cost advantage.","attributionJson":"[{\"source\":\"GIGAZINE\",\"url\":\"https://gigazine.net/news/20260819-deepseek-v4-flash-agent/\",\"title\":\"DeepSeek V4 Flash Criticized for High Benchmark Scores but Struggling in Real Tasks, Orchestration Challenges\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":4719,"outputTokens":599,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1787118118,"createdAt":"2026-08-19T05:35:14.000Z","publishedAt":"2026-08-19T05:36:44.000Z","updatedAt":"2026-08-19T05:35:14.000Z"},"cluster":{"id":"c_e93d29e53f0003d9e9057508","canonicalTitle":"DeepSeek V4 Flashはベンチマークスコアは高いが実際のタスクでは苦戦しているという指摘、オーケストレーションに課題","representativeArticleId":"a_7649cc31c38671cc6b8708d9","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[\"DeepSeek-V4 Flash\",\"DeepSeek-V4 Pro\"],\"studios\":[],\"people\":[],\"type\":\"news\",\"domain\":\"other\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-08-19T04:15:00.000Z","lastSeenAt":"2026-08-19T04:15:00.000Z","updatedAt":"2026-08-19T05:36:45.000Z"},"attribution":[{"source":"GIGAZINE","url":"https://gigazine.net/news/20260819-deepseek-v4-flash-agent/","title":"DeepSeek V4 Flashはベンチマークスコアは高いが実際のタスクでは苦戦しているという指摘、オーケストレーションに課題"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":["DeepSeek-V4 Flash","DeepSeek-V4 Pro"],"studios":[],"people":[],"type":"news","domain":"other","is_roundup":false},"keyFacts":null}