I'm not sure why it takes so long, but mine does exactly the same thing. I've found that the wait is lessened somewhat by booting into the original apple firmware before connecting to the computer. There's no reason for it to take less time this way, but for some reason it does.
It's not Rockbox causing the slow mount, it's Disk Mode.
FF