I would say that you have accidentally adjusted it whilst the car was in reverse.
As others have said, stick the car into reverse gear, set the passenger mirror to where you want it for when you are reversing. When you then pull away in first, after about 5 or 10 seconds, the mirror will move back up the position you had set it for normal driving.