PS5LM turns a jailbroken PlayStation 5 into an OpenAI-compatible LLM server (github.com)
On a PS5 Slim, the README reports 207 tokens/s for a 0.8B Qwen model, 55 tokens/s for a 9B, and about 20 tokens/s for a 27B model at 64k context. The console gives the model 11.4 GB of shared memory.
Sign in to save