Your problem:
When you created the toolbar, you selected a folder. If that folder has other folders inside, you will see folders on your toolbar.
The fix:
To fix this, create a folder specifically for your toolbar and create shortcuts to all your game executables (.exe files) like I have done for my creative tools.
Create a new toolbar that points to the folder with all your new shortcuts in and your icons will appear.