Thanks to the guys at the IRC chan, I removed the tagcache code from the sources and rebuilt them. Since I don't need tagcache, the build is fine for me and I can enjoy the latest CVS updates (like the re-enabled pitch screen).
So if you know how to compile your own version of Rockbx, you should be able to have Rombox working again (by removing something that you do not need).