dtech's solution works: use msysgit, "the official version of Git for Windows".
The bad point is that msysgit uses its own MSYS layer. The installer does not propose integration with existing MSYS setup. A project exists here which aims at providing such integration, but from its TODO list, it seems that all Git auto-tests don't pass yet. It is pre-released v0.2.