The gear number indicator is not the problem. All that does is compare the engine speed (revs) with the road speed. Your engine speed goes up, with constant road speed, so the indicator thinks you are in a lower gear.
What you are describing sounds like a slipping clutch. This can first show itself at low speed in high gears because it is trying to transmit high torque.