Ah, the PSP was so much fun back in its day. I only had a few actual PSP games, I was much more interested in that thing for all the homebrew and emulation stuff I could do on it.
I recently got an Anbernic RG351V, which is nowhere near as capable as the Steam Deck but is a fantastic platform for playing emulated games. The AmberElec custom firmware I'm using just runs a RetroArch installation with some nice theming, and the experience of hacking on it reminds me a lot of the good ol' PSP homebrew days.
Great question, I'd guess emulating it is within the capabilities of the device. (I don't know much about the Spectrum but just a guess based on age). Would those games work well on a controller?
The RG351 is really just an ARM Linux box inside a Gameboy shaped case, so it can really do pretty much whatever within the limits of its hardware. It's a really neat little device, I've been having lots of fun with mine. I've played mostly SNES and Gameboy stuff on it (that's where my nostalgia lies), but I've run a few PSP games on it with decent to middling results.
Perhaps general-purpose computing has been handed a lifeline because playfulness is its essence?