Unfortunately no, they don't work in Windows. :help scroll-mouse-wheel
specifically mentions that they are for the X11 GUIs:
For the X11 GUIs (Motif, Athena and GTK) scrolling the wheel generates key presses <ScrollWheelUp>, <ScrollWheelDown>, <ScrollWheelLeft> and <ScrollWheelRight>.