Rockbox does not really support video yet. For what there is, click on the "wiki" link at the left, from there click on the "plugin index" link.
The resulting page shows you all the plugins (they come bundled with the firmware when you download it) made so far. There is a mpeg player one, click that to get all the detail you want.
h