If you stop (not pause) a slideshow you can select the next image you wish to start with in the Filmstrip, hold the Shift key and press Play to start on that image instead of the first slide. Otherwise the slideshow will always begin on the first image when restarted.

Additional Slideshow Controls:

Right arrow – advances one image forward
Left arrow – advances one image back
Spacebar – pause/resume
Escape – stop