I think the fuse for the headlamp washers is the same for all the other squirty bits - though no harm in checking both fuse boxes. Make sure that if you are gonna pull each fuse to have a look-see, then remove the ignition key, and turn off the interior lights.
You can also check the pump relatively easy, but you need to remove the right fog light grille (one philips screw, and carefully pull), and the fog lamp also (3 Ph screws, and unclip the wiring). The headlamp washer pump is on the front face of the resevior, and is the one nearest the outer edge - ie, looking through the fog lamp aperture towards the rear, the h/l washer is on the left.
HTH