{"rewrite":{"id":"r_ca7ba35a8e4f922ef9dde528","clusterId":"c_cf773f6b2cd6017bb5fda1d7","slug":"nvidia-expands-ai-for-media-with-frame-generation-and-lip-sync-tools","model":"deepseek-v4-flash","headline":"NVIDIA Expands AI for Media with Frame Generation and Lip Sync Tools","summary":"NVIDIA added several AI tools to its AI for Media collection for the broadcast industry in September 2026. The new additions include 3D Body Pose, which converts joint positions into 2D and 3D motion data, Video Frame Generation for raising frame rates two to four times, Video Super Resolution for upscaling, TrueHDR for real-time SDR to HDR conversion, LipSync for matching mouth movements to audio, Active Speaker Detection, and Studio Voice for reducing noise and reverberation.","whyItMatters":"NVIDIA is building out a single toolset for broadcasters that covers capture, motion, upscaling, and audio, which points to production pipelines where real-time translation and dubbing run alongside the video processing itself.","webCardHtml":"\u003cp\u003eNVIDIA 3D Body Pose estimates joint positions and angles and turns them into structured 2D and 3D data without markers on the subject, which the source suggests for tracking athletes during replays and for animation production. Video Frame Generation inserts generated frames between existing ones to raise frame rates by two to four times, and work continues toward 8x slow motion. Video Super Resolution upscales while reducing noise, blur, and compression artifacts, with a real-time mode and a quality mode. TrueHDR converts SDR to HDR in real time at up to about 2000 nits.\u003c/p\u003e\u003cul\u003e\u003cli\u003e\u003cstrong\u003eNVIDIA 3D Body Pose\u003c/strong\u003e: Estimates joint positions and angles as structured 2D and 3D data without markers\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eVideo Frame Generation (VFG)\u003c/strong\u003e: Inserts generated frames to raise frame rates two to four times\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eNVIDIA Video Super Resolution (VSR)\u003c/strong\u003e: Upscales video and reduces noise, blur, and compression artifacts\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eNVIDIA TrueHDR\u003c/strong\u003e: Converts SDR to HDR in real time at up to about 2000 nits\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eNVIDIA LipSync\u003c/strong\u003e: Changes mouth movements to match input audio\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eActive Speaker Detection\u003c/strong\u003e: Identifies multiple speakers in an audio file\u003c/li\u003e\u003cli\u003e\u003cstrong\u003eStudio Voice\u003c/strong\u003e: Reduces noise and reverberation in recorded data\u003c/li\u003e\u003c/ul\u003e","blueskyPost":"NVIDIA's AI for Media additions include 3D Body Pose and Video Frame Generation, tools that touch motion capture and frame rate work. The broadcast pipeline is where those tasks used to need human hands.","twitterPost":"NVIDIA's AI for Media now covers motion data and frame generation, tasks broadcast crews used to do by hand.","threadsPost":"NVIDIA's AI for Media expansion covers motion data with 3D Body Pose and frame rate work with Video Frame Generation. Those are the parts of broadcast production that have needed human operators. NVIDIA is selling the automation directly to the industry that employs them.","newsletterBlurb":"NVIDIA expanded its AI for Media collection with tools aimed at broadcast work. The additions cover motion capture without markers, frame generation that raises frame rates two to four times, video upscaling, real-time SDR to HDR conversion, and audio cleanup. Pairing LipSync with Active Speaker Detection opens real-time translation and lip-sync dubbing in the same pipeline.","attributionJson":"[{\"source\":\"GIGAZINE\",\"url\":\"https://gigazine.net/news/20260915-nvidia-ai-for-media/\",\"title\":\"NVIDIA Announces Major Expansion of \\\"NVIDIA AI for Media,\\\" an AI Collection for the Broadcast Industry Including Video Frame Interpolation and Live Translation\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":4719,"outputTokens":839,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1789464566,"createdAt":"2026-09-15T09:23:57.000Z","publishedAt":"2026-09-15T09:28:21.000Z","updatedAt":"2026-09-15T09:28:21.000Z"},"cluster":{"id":"c_cf773f6b2cd6017bb5fda1d7","canonicalTitle":"NVIDIAが映像フレーム補間や生中継翻訳などの放送業界向けAIコレクション「NVIDIA AI for Media」の大幅拡充を発表","representativeArticleId":"a_2b26b6d19d816e4f2bc03ef2","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[\"NVIDIA AI for Media\"],\"studios\":[\"NVIDIA\"],\"people\":[],\"type\":\"news\",\"domain\":\"industry\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-09-15T08:39:00.000Z","lastSeenAt":"2026-09-15T08:39:00.000Z","updatedAt":"2026-09-15T09:28:20.000Z"},"attribution":[{"source":"GIGAZINE","url":"https://gigazine.net/news/20260915-nvidia-ai-for-media/","title":"NVIDIAが映像フレーム補間や生中継翻訳などの放送業界向けAIコレクション「NVIDIA AI for Media」の大幅拡充を発表"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":["NVIDIA AI for Media"],"studios":["NVIDIA"],"people":[],"type":"news","domain":"industry","is_roundup":false},"keyFacts":null}