The 364.xx drivers are buggy. It's best to use version 362.00 until NVIDIA addresses these issues.
WCCFtech has reported that many users are experiencing serious problems with the 364.72 drivers, ranging from crashes and hangs to outright hardware failure (i.e. the card is bricked). These issues don't seem to affect everyone, but it's best not to take the risk.
Several other versions in the 364 series are affected with similar bugs (though not necessarily of the same severity). The last driver prior to the 364 series is 362.00, which has been problem-free for most users.