{"rewrite":{"id":"r_5dc5cb1646f74d161ffaf905","clusterId":"c_dc774a68976d4e103ce74204","slug":"time-serves-ai-crawlers-a-separate-markdown-site-with-ads","model":"deepseek-v4-flash:free","headline":"TIME Serves AI Crawlers a Separate Markdown Site With Ads","summary":"Software developer Vincent Schmalbach found that TIME delivers a simplified Markdown version of its site to some AI crawlers, including ClaudeBot and PerplexityBot, while human browsers get the full HTML page. The AI version includes ads from Mobian and sponsor content that do not appear on the human-facing site.","whyItMatters":"TIME's split delivery shows publishers are beginning to treat AI crawlers as a distinct audience with its own ad inventory, a shift that could reshape how web content is monetized.","webCardHtml":"\u003cp\u003eSoftware developer Vincent Schmalbach tested TIME\u0026#39;s site by changing the User-Agent header. A normal browser received about 303KB of HTML, while ClaudeBot and PerplexityBot got about 13KB of Markdown with a content-type of text/markdown.\u003c/p\u003e\u003cp\u003eThe AI version carries ads from Mobian, an AI advertising technology firm, and includes a per-visit ad display ID. Sponsored pages insert sponsor information in a question-and-answer format, labeled as sponsored content, so that generative AI can read it easily. These ads do not show on the human-facing pages.\u003c/p\u003e\u003cp\u003eTIME said that on many days, AI bot traffic exceeds human traffic. Schmalbach called the case an early example of what happens when the web\u0026#39;s main readers are AI models.\u003c/p\u003e","blueskyPost":"TIME's split delivery to AI crawlers means the ads those bots see are separate from the human ad inventory. Vincent Schmalbach's find exposes a second, unmeasured ad market that never reaches a human view.","twitterPost":"TIME's AI crawler pages carry ads from Mobian that human readers never see. Vincent Schmalbach's find exposes a parallel ad inventory outside human view.","threadsPost":"TIME's AI crawlers get a Markdown site with ads from Mobian that humans never see. Vincent Schmalbach's discovery means there is a parallel ad inventory running outside the human-facing site, and it is not being measured by the same standards.","newsletterBlurb":"TIME is serving AI crawlers a different version of its site, a Markdown page with ads that human readers never see. Developer Vincent Schmalbach documented the split, and TIME says bots often outnumber human visitors.","attributionJson":"[{\"source\":\"GIGAZINE\",\"url\":\"https://gigazine.net/news/20260806-time-serve-ai-bot-different-website/\",\"title\":\"TIME誌が人間とAIクローラーに異なるページを配信、AI向け広告も確認される\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":4987,"outputTokens":540,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1786384684,"createdAt":"2026-08-10T17:56:00.000Z","publishedAt":"2026-08-10T17:56:44.000Z","updatedAt":"2026-08-10T17:56:00.000Z"},"cluster":{"id":"c_dc774a68976d4e103ce74204","canonicalTitle":"TIME誌が人間とAIクローラーに異なるページを配信、AI向け広告も確認される","representativeArticleId":"a_d691150b39df6a5da03e21a6","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[],\"studios\":[],\"people\":[\"Vincent Schmalbach\"],\"type\":\"news\",\"domain\":\"other\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-08-06T05:40:00.000Z","lastSeenAt":"2026-08-06T05:40:00.000Z","updatedAt":"2026-08-10T17:56:44.000Z"},"attribution":[{"source":"GIGAZINE","url":"https://gigazine.net/news/20260806-time-serve-ai-bot-different-website/","title":"TIME誌が人間とAIクローラーに異なるページを配信、AI向け広告も確認される"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":[],"studios":[],"people":["Vincent Schmalbach"],"type":"news","domain":"other","is_roundup":false},"keyFacts":null}
