To create a custom wallpaper, simply resize whatever image you desire to the dimensions of your player's screen. For example, 320x240 for the iPod 5G, 176x220 for the Nano, etc.
Then save the image on your player, and browse to it with the file browser in Rockbox, and hold select on the file, then select 'set as backdrop'.