I believe the issue is that Windows uses multicast DNS to advertise servers on the local network and the default DNS system the Android browser uses does not resolve mDNS for some reason.
Android does have mDNS support that apps can use though, so one solution may be to use a browser app that supports mDNS such as ZeroConf Browser. Your call whether that’s more convenient than entering the IP address.