What codec are you using when it's unresponsive? I have noticed that both speex and nsf formats are terribly slow in responding to keypresses. I believe that has to do with how the codecs themselves are programmed, but I haven't looked too closely at it yet.