My mk3 cab has a sort of similar problem, the drivers side works sometimes, but more often than not it doesn't work. However the passenger window switch on the drivers side does work the passenger window.
The motor must be fine as when I hold the key in the unlock position, the window goes down fine and returns on the key too.
I did start looking at it but drew a blank, if you find out a switch sorts it let me know.