hi starry,
i did a quick calcualtion based purely on theory and worked out that the maximum performance gain you can get by using a bigger pipe would be about 2-3%(best case) for 3" pipe. the restrictive element is the inlet to the turbo, which you can;'t change. the gains you get from using a bigger pipe are purely from reduced pipe friction losses (the gas rubbing against the pipe surface)
the only other thing i could suggest but its based purely on a guess, is that it could be worse. reason is because you have a big pipe going to a small inlet on the turbo, in order to make the air get through the small gap you end up making it hotter (not by much) but worse still the airflow may become turbulent rather than laminar, so the compressor doesn't work as efficiently.
so to cut a long story short, i would say your okay.
have a nice day
sanj