Try using the latest build. Anything newer than r28011 should not have this problem.
If for some reason you must use an older build, the patch in FS#11601 should prevent the issue. You'll have to follow the process in the Wiki to build Rockbox from source, of course.