Try adjusting the microphone however that doesn't explain why it would work the second time you use it ie phone them.
Is the bluetooth on the phone set up correctly? My phone gives me the option of using the phone however the callers still come through the speakers!!! Have you tried resetting the Fiscon? That might help.