I just figured it out. I added myself to the video
and games
group. I'm not sure which one did it, but it worked.
One oddity I ran into while messing with this: before making the group change I ran glxgears instead; as root it was getting about the same FPS as if I'd ran it from the default session, but as my user it was reporting around 500fps.