(Assuming Windows 7 or similar modern version of Windows.)
Go to the control panel, sound, recording tab. Find "listen to this device", make sure it's unchecked and click apply or ok. Also look for options/recording devices for recording the outgoing audio, and make sure they are unchecked/that this recording device is not select as default.