Questions:
Do you have fade on stop/pause enabled? (It's enabled by default.)
Have you disabled "First keypress enables backlight." or whatever it's called.
Both of these settings, if enabled, can SEEM to cause problems very similar to what you're describing simply because they change the way things work enough that if you aren't expecting it, it seems to be not responsive.