AIFIRST Running a 90M conversational LLM on the Sony PSP from 2004
The brief
A developer ran a 90-million-parameter conversational language model entirely on a Sony PSP, the gaming handheld released in 2004.
Key points
- The LLMPSP project on GitHub shows that 90M parameters is about the practical ceiling for the device before response quality degrades significantly.
- It serves as a fun benchmark for just how constrained early 2000s mobile hardware really is.
Sources
- redditreddit.com
- Source codegithub.com