The SoC is more than capable (~500MHz ARM926, 32MB RAM) and is well supported by upstream/mainline Linux.
Keep in mind that this thing isn't meant to run directly off of a battery, and only has a line output.
But there's no technical reason why a rockbox port (hosted or native) isn't possible for this thing. It's just a matter of applying sufficient elbow grease.