{"rewrite":{"id":"r_533b79b7ba4021de1379a365","clusterId":"c_6871af7f24f57221cd740423","slug":"roblox-implements-real-time-multimodal-moderation-to-catch-contextual-violations","model":"deepseek-v4-flash","headline":"Roblox Implements Real-Time Multimodal Moderation to Catch Contextual Violations","summary":"Roblox has introduced a real-time multimodal moderation system that evaluates entire scenes-including 3D objects, avatars, and text-simultaneously, rather than reviewing individual items separately. The system is designed to catch violations that occur only when harmless elements are combined, such as creating inappropriate figures or outfits. Naren Koneru, head of Trust \u0026 Safety Engineering, explained the mechanism in an interview with 4Gamer.","whyItMatters":"The shift from reviewing individual items to evaluating entire scenes in real time represents a technical change in how Roblox handles moderation, targeting contextual violations that previous tools missed.","webCardHtml":"\u003cp\u003eRoblox has deployed a new automated moderation system that evaluates entire scenes in real time, including 3D objects, avatars, and text, rather than reviewing individual items separately. Naren Koneru, Vice President of Engineering for Trust and Safety, told 4Gamer that the previous tools missed contextual violations that occur when harmless items are combined-for example, combining avatar clothing items to create outfits that suggest prohibited figures. The system uses an AI model to determine whether the combination of elements at a given moment violates community standards.\u003c/p\u003e","blueskyPost":"Roblox rolls out real-time multimodal moderation that evaluates entire scenes-3D objects, avatars, text-together, not piece by piece. Targets contextual violations like combining harmless items to imitate inappropriate figures.","twitterPost":"Roblox introduces real-time multimodal moderation that evaluates entire scenes (3D objects, avatars, text) simultaneously, not individual items. Aims to catch contextual violations like combining harmless items to create inappropriate figures.","threadsPost":null,"newsletterBlurb":"Roblox has implemented a real-time multimodal moderation system that evaluates entire scenes-including 3D objects, avatars, and text-simultaneously, rather than reviewing individual items separately. The system targets contextual violations that occur when harmless elements are combined, such as creating inappropriate figures or outfits. Naren Koneru, head of Trust \u0026 Safety Engineering, detailed the mechanism in an interview with 4Gamer.","attributionJson":"[{\"source\":\"4Gamer.net\",\"url\":\"https://www.4gamer.net/games/612/G061218/20260609003/\",\"title\":\"[Interview] Online Game Platform 'Roblox' Implements Automated Moderation: System Developer Discusses the Mechanism and Aims of Enhanced Security\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":4180,"outputTokens":554,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1781056418,"createdAt":"2026-06-10T01:41:25.000Z","publishedAt":"2026-06-10T01:45:33.000Z","updatedAt":"2026-06-10T01:45:33.000Z"},"cluster":{"id":"c_6871af7f24f57221cd740423","canonicalTitle":"［インタビュー］オンラインゲームプラットフォーム「Roblox」が自動モデレーションを実装。セキュリティ強化の仕組みと狙いをシステム開発者に聞く","representativeArticleId":"a_7c9a6964f559c39027c8bd7e","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[\"Roblox\"],\"studios\":[],\"people\":[],\"type\":\"news\",\"domain\":\"games\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-06-10T01:00:00.000Z","lastSeenAt":"2026-06-10T01:00:00.000Z","updatedAt":"2026-06-10T01:45:33.000Z"},"attribution":[{"source":"4Gamer.net","url":"https://www.4gamer.net/games/612/G061218/20260609003/","title":"［インタビュー］オンラインゲームプラットフォーム「Roblox」が自動モデレーションを実装。セキュリティ強化の仕組みと狙いをシステム開発者に聞く"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":["Roblox"],"studios":[],"people":[],"type":"news","domain":"games","is_roundup":false},"keyFacts":["Roblox deployed a real-time multimodal moderation system that evaluates entire scenes including 3D objects, avatars, and text simultaneously, rather than reviewing individual items separately.","Naren Koneru, Vice President of Engineering for Trust and Safety, told 4Gamer that previous tools missed contextual violations that occur when harmless items are combined.","The system uses an AI model to determine whether the combination of elements at a given moment violates community standards."]}