I have just fixed this myself. I had to format the device again, but this time without the full format option.
I started it up and it worked well. Luckily, the firmware wasn't overwritten. I made a voice recording and listened to it. Then, I put some music on it and it worked also.
The solution was to format it with quick format after the long formatting.