Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native app
A few weeks ago I came across a post from u/metover about PS5LM, his llama.cpp port for the jailbroken PS5. The project looked really interesting, so I forked it and made a few changes. Well, more than a few. This is where it ended up.
The original runs as a payload on the CPU. That limits it to about 6 GiB of memory and small models. My fork runs llama.cpp as a native PS5 app on the GPU (Vulkan through a RADV port). The app gets about 11.4 GiB of memory to work with, which is enough for much bigger models:
- Qwen 3.8 27B (IQ2_XXS, 64k context): ~20 tok/s
- Gemma 4 E4B: ~61 tok/s
- Llama 3.2 3B: ~124 tok/s
What the app does
- Dashboard on the TV: live tok/s, GPU and CPU use, power draw, temperatures and fan, and how memory splits between the model and the KV cache
- Model library: any GGUF on internal storage, USB or M.2. Each one shows the context it would get and whether it fits before you load it.
- Get models: browse Hugging Face from the console. It checks whether a file fits and downloads it with resume, retries and a SHA-256 check. A Downloads page lets you manage the queue.
- Chat from any device: llama.cpp's web UI at http://<console_ip>:8081, plus an OpenAI-compatible API. Vision works with Gemma 4.
- Automatic planning: the app picks the longest context and the KV cache type that fit in free memory.
- Settings, logs..
Requirements: a jailbroken PS5 with etaHEN, kstuff and ShadowMountPlus. elfldr and ftpsrv are recommended.
I have opened a PR to the original repo with the first version of the app cobanov/PS5LM#12. It hasn't been merged yet. If it gets merged, I will open PRs for the rest of the changes too. For now, you can find the app here:
Repo: abhi245y/PS5LM
All credit for the original port and the research goes to u/metover.
885 points · 108 comments
Mentions
很多人对这个感兴趣呀，项目地址在这里： abhi245y/PS5LM-Plus 另外PS5破解也很简单，只要没升级到最新系统，改个DNS开个网页就破解了
想把越狱 PS5 变成本地大模型服务器？PS5LM Plus 的关键是换一种运行方式。 abhi245y/PS5LM-Plus 不做只有约 6GiB 内存、用不了 GPU 的 payload，而是做原生应用，拿到 12GiB 内存，通过 Vulkan 跑 llama.cpp，向局域网提供兼容 OpenAI 的 API。 移植通用引擎，而非逐个模型写内核，模型支持就能跟着上游走。工程妥协也很实在：原地卸载会残留约 5GiB 占用，切模型干脆重启应用。前提是已有越狱环境。
Spotify on PS5. A native Spotify app built for jailbroken PS5 consoles browse your library, play playlists, and control everything directly from your TV Runs at 60 FPS. It’s an unofficial community project (not affiliated with Spotify or Sony). - github.com/abhi245y/spot5/releases/tag/v1.0.0 t.co
Impressed at the ability to run AI LLMs on the PS5 Directly, and not through Linux which is better because there's less VRAM overhead Free AI at home 😳 abhi245y/PS5LM
@Wbackdown Qwen 3.8 27B using an IQ2_XXS quant with a 64k context, using about 11Gb of memory. abhi245y/PS5LM
Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native app A few weeks ago I came across a post from u/metover about PS5LM, his llama.cpp port for the jailbroken PS5. The project looked really interesting, so I forked it and made a few changes. Well, more than a few. This is where it ended up. The original runs as a payload on the CPU. That limits it to about 6 GiB of memory and small models. My fork runs llama.cpp as a native PS5 app on the GPU (Vulkan through a RADV port). The app gets about 11.4 GiB of memory to work with, which is enough for much bigger models: - Qwen 3.8 27B (IQ2_XXS, 64k context): ~20 tok/s - Gemma 4 E4B: ~61 tok/s - Llama 3.2 3B: ~124 tok/s What the app does - Dashboard on the TV: live tok/s, GPU and CPU use, power draw, temperatures and fan, and how memory splits between the model and the KV cache - Model library: any GGUF on internal storage, USB or M.2. Each one shows the context it would get and whether it fits before you load it. - Get models: browse Hugging Face from the console. It checks whether a file fits and downloads it with resume, retries and a SHA-256 check. A Downloads page lets you manage the queue. - Chat from any device: llama.cpp's web UI at http://<console_ip>:8081, plus an OpenAI-compatible API. Vision works with Gemma 4. - Automatic planning: the app picks the longest context and the KV cache type that fit in free memory. - Settings, logs.. Requirements: a jailbroken PS5 with etaHEN, kstuff and ShadowMountPlus. elfldr and ftpsrv are recommended. I have opened a PR to the original repo with the first version of the app cobanov/PS5LM#12. It hasn't been merged yet. If it gets merged, I will open PRs for the rest of the changes too. For now, you can find the app here: Repo: abhi245y/PS5LM All credit for the original port and the research goes to u/metover.