So it seems there are several fixes for this problem. However, this is what fixed my specific problem.
- Go to Device Manager
- Uninstall everything under IDE ATA/ATAPI controllers
- Reboot
https://forums.techguy.org/threads/solved-dvd-drive-shows-up-in-bios-but-not-in-windows.600107/