You can add an image to the button. Depending on what version of Visual Studio you are using there is a zip file that contains some images you can use for your application.
Have a look into the location below you might find the arrows your looking for, replace (Microsoft Visual Studio 10.0) with the appropriate version you use.
