Llama.cpp ported to a jailbroken PS5: any GGUF model runs natively

⚡ The gist in 5 seconds - llama.cpp now works on a jailbroken PlayStation 5: the PS5LM project runs GGUF models right on the console, with no streaming from a PC. - The code is open on GitHub (github.com/cobanov/PS5LM); the thread has gathered 342 points and 83 comments on Hacker News. - The prerequisite is a jailbroken console; specific firmware and model requirements are not specified in the post. ### 🔍 What was found A PS5LM repository by developer cobanov surfaced on Hacker News — a port of llama.cpp for the jailbroken PlayStation 5. The post's wording is straightforward: "run any GGUF model natively on the console" — that is, any model file in GGUF format can be executed on the console, not just a pre-baked set. Within 24 hours the post collected 342 points and 83 comments — notable interest for a homebrew project targeting a locked-down platform. The mechanics are that llama.cpp is a C/C++ inference engine that works specifically with GGUF containers and quantized weights; "natively" here means the computation runs on the console's own hardware, not on a remote server or a PC host over the network. In other words, the user puts the model file on the PS5 and runs it locally, powered entirely by the console. The full list of supported quantizations, firmware requirements, and the installation method are not disclosed in the original post — those are worth checking in the repository's README. ### 💡 Why it matters Over the past two years, local inference has been moving off desktops onto anything with enough memory: mini-PCs, SBCs, NPU boards. The PS5 is a curious entry in this lineup: the console has a huge installed base and a closed OS, and a jailbreak opens its resources up to third-party code. PS5LM shows that GGUF models can be run on this kind of hardware too, without a cloud subscription and without a PC. The limitation is obvious: without a jailbreak the project is unusable, and the exploit itself only works on some firmware versions — so the audience is inherently narrow, and there is no talk of a mass-market scenario.