You've got a snake on the loose !!!

Seriously, it sounds like the brake servo. The servo will "vent" the stored vacuum as you press further on the brake pedal. Even if you think you are holding the brakes perfectly "constant", it is very difficult to actually hold the pedal in a fixed position, unless you are actually trying to do so.
Does the brake pedal sink to the floor under constant pressure?
Does the vacuum in the servo correctly build up? (if you dont know how to check this, let me know, and I'll post the simple details).