Well, yes, sort of. Of course, it would be best to ditch Windows Explorer as a whole and move on to another file manager of your chosing. Most of the alternative file managers can do this.
If you wanna stick with Windows Explorer, the extension QTTabBar offers this functionality. There's a screenshot available clearly offering this option. Looks like it does what you want but I don't know if it works with Windows 8.