That certainly looks like the right place for a reverse switch, there should be 2 wires going to it. If you unplug it and use something like a paperclip to link the 2 wires then switch on your ignition and see if the rev lights are on.
Have you checked both bulbs too?