{"rewrite":{"id":"r_cbd64d2588338c4d88a5d3e0","clusterId":"c_cd436f0c2fa14009ee6ce834","slug":"garlic-llm-runs-a-9-billion-parameter-model-on-a-jailbroken-ps4","model":"deepseek-v4-1-flash","headline":"Garlic LLM Runs a 9-Billion-Parameter Model on a Jailbroken PS4","summary":"Developer Leonardo Alegria released Garlic LLM, an open-source app that runs a 9-billion-parameter Qwen3.5-9B model on a jailbroken PlayStation 4. It talks directly to the console's GPU, bypassing the missing drivers, and reaches 31 to 39 tokens per second for text and up to 43 for code. It needs GoldHEN and works on firmware 11.52.","whyItMatters":"The PS4 has no APIs or machine learning libraries for general-purpose GPU compute from unofficial apps, so Alegria's app assembles the low-level instructions a driver would normally generate and hands them to the GPU itself, which is why a 2013 console can run a 9-billion-parameter model offline.","webCardHtml":"\u003cp\u003eThe model is Alibaba\u0026#39;s Qwen3.5-9B, quantized to 3 and 4 bits so the weights plus acceleration data fit in about 4.5 GiB. Speculative decoding, which checks several tokens ahead at once, does the rest of the speed work. The context window is 16,000 tokens.\u003c/p\u003e\u003cp\u003eGarlic LLM also handles voice input and conversation through the Parakeet TDT 0.6B v3 speech recognition model and the Chatterbox speech synthesis model. Voice mode costs memory, and generation drops to about 22 tokens per second. The source is on GitHub under GPLv3, with a roughly 5.7 GB install package on Hugging Face.\u003c/p\u003e","blueskyPost":"Garlic LLM runs a 9-billion-parameter Qwen3.5-9B model on a jailbroken PS4, talking straight to the GPU with no drivers. 31 to 39 tokens per second for text, up to 43 for code, offline. Needs GoldHEN and firmware 11.52.","twitterPost":"Garlic LLM runs a 9-billion-parameter Qwen3.5-9B model on a jailbroken PS4 by driving the GPU directly, no drivers needed. 31 to 39 tokens per second for text, up to 43 for code, fully offline. Needs GoldHEN and firmware 11.52.","threadsPost":null,"newsletterBlurb":"Developer Leonardo Alegria released Garlic LLM, an open-source app that runs a 9-billion-parameter Qwen3.5-9B model on a jailbroken PlayStation 4. With no GPU drivers available to unofficial apps, the app assembles the low-level instructions itself and reaches up to 43 tokens per second. It requires GoldHEN and works on firmware 11.52.","attributionJson":"[{\"source\":\"GIGAZINE\",\"url\":\"https://gigazine.net/news/20261117-playstation-4-garlic-llm/\",\"title\":\"\\\"Garlic LLM\\\" runs a 9-billion-parameter AI model on a jailbroken PlayStation 4 at up to 43 tokens per second\"}]","lintFlagsJson":null,"lintHits":0,"costUsd":0,"inputTokens":5641,"outputTokens":853,"status":"published","repairAttempts":0,"nextRepairAt":null,"factsAttemptedAt":1794882570,"createdAt":"2026-11-17T02:25:44.000Z","publishedAt":"2026-11-17T02:28:28.000Z","updatedAt":"2026-11-17T02:28:28.000Z"},"cluster":{"id":"c_cd436f0c2fa14009ee6ce834","canonicalTitle":"脱獄したPlayStation 4で90億パラメーターのAIモデルを毎秒最大43トークンで動作させる「Garlic LLM」が登場","representativeArticleId":"a_5a0f526f9d162ebc6214aa84","sourceCount":1,"writtenSourceCount":1,"writeAttempts":0,"isSolo":true,"entitiesJson":"{\"anime_titles\":[],\"manga_titles\":[],\"work_titles\":[\"Garlic LLM\"],\"studios\":[\"Sony\"],\"people\":[],\"type\":\"news\",\"domain\":\"games\",\"is_roundup\":false}","contentType":"news","status":"published","firstSeenAt":"2026-11-17T01:49:00.000Z","lastSeenAt":"2026-11-17T01:49:00.000Z","updatedAt":"2026-11-17T02:28:23.000Z"},"attribution":[{"source":"GIGAZINE","url":"https://gigazine.net/news/20261117-playstation-4-garlic-llm/","title":"脱獄したPlayStation 4で90億パラメーターのAIモデルを毎秒最大43トークンで動作させる「Garlic LLM」が登場"}],"entities":{"anime_titles":[],"manga_titles":[],"work_titles":["Garlic LLM"],"studios":["Sony"],"people":[],"type":"news","domain":"games","is_roundup":false},"keyFacts":["Garlic LLM is an open-source app by developer Leonardo Alegria that runs a 9-billion-parameter model on a jailbroken PlayStation 4.","The model is Alibaba's Qwen3.5-9B, quantized to 3 and 4 bits to fit in about 4.5 GiB.","Garlic LLM reaches 31 to 39 tokens per second for text and up to 43 tokens per second for code.","Running it requires GoldHEN, and Alegria confirmed it works on firmware version 11.52.","The source code is published on GitHub under the GPLv3 license, with an install package of about 5.7 GB on Hugging Face."],"pageLinks":{"healthSlugs":["garlic-llm","sony"],"storySlugs":[],"entities":[{"slug":"garlic-llm","supported":0,"disputed":0,"contradicted":0,"unverified":1,"overall":"unverified","story_count":1,"has_dossier":false},{"slug":"sony","supported":6,"disputed":0,"contradicted":1,"unverified":14,"overall":"red","story_count":24,"has_dossier":true}],"stories":[],"entitiesOk":true,"storiesOk":true}}
