Visual Studio needs the project system to track which version of the .NET Framework you're targeting and which DLLs you have referenced. There is no way outside the project structure to do this.
You could look into the lighter project structure (xproj) used by ASP.NET 5. Another alternative would be Visual Studio Code, which doesn't required a project system.