There are specific memory population guidelines for your Server
Refer page 40-49 for more information. The Service Manual can be downloaded from the below link.
The existing is a Dual Rank Registered ECC modules, and I hope you're installing in the B1-B12 slots, after populating in the A1-A12 Slots.