How do I even begin to troubleshoot this?
Ensure you've linked the GPO to an AD container containing the users you want it to apply to (it's a user-level policy, so it applies to user objects, not computer objects).
Use GPResult
to determine if your GPO is properly applying to the users you're testing with.
Troubleshoot problems further based on GPResult's output.