Did it improve after fitting the lambda sensor temporarily?
My old Audi 100 did this, then it went back to what it was doing before.
The problem was the reverse of yours, it held back over 4200 rpm.
Another suggestion, does it rev cleanly when not under load?
You could stick a timing light on it to make sure the timing is advancing, could show up a knackered knock sensor?