I sometime experience late connects to usb while trying to not enter usb mode with my mini. Those occur some seconds (maybe up to 10 seconds, haven't checked) after inserting the cable. Your five minutes sound pretty much to me, but maybe this is a similar issue? Does your problem occur every time?