Get the Rockbox sources as usual. In the /tools/ folder of the Rockbox sources is a script called rockboxdev.sh, running that can download and install the Cross Compilers for you. Then you simply need to add them to your path.
For that you'll have to see what you need to specifically do for your install of linux, as it can vary.