When using the US International layout, if you press the '
key twice then it will generate ''
after the second press.
In your case, perhaps the keyboard repeat delay is too short and one press of the '
key is being interpreted as two presses by the operating system.
Using the Keyboard control panel, you can play around with the repeat delay and rate, then type in the test text box to see if this might be the cause.