Can someone help me out which settings to alter?
You have an International keyboard layout set for your keyboard:
With this keyboard layout the ' keystroke becomes a modifier to enable entering of special characters.
To get a single ' character you need to type '+Space.
To get a character like é you need to press Alt Gr+e.
If you want ' to have the normal behavior change the keyboard layout to the appropriate non-international version.
- You will then have to use an alternate method to input é
See How to Change Your Keyboard Layout in Windows 8 or 10 for more information.
Type International and Special Characters using the right Alt key or the following modifier keys: Apostrophe('), Accent Grave(`), Quotation Mark("), Tilde(~), and Circumflex(^). To type just the modifier key by itself, type Space following the modifier key.
...
á é í ó ú <Right Alt> a e i o u Acute Á É Í Ó Ú <Right Alt> A E I O U Source Microsoft Keyboards - English (US-International) Typing Diacritics And Special Characters