With the latest version, you should be able to just Right click the Solution, Add New Project, and select C# Windows Form project type. In my tests, this configured everything automatically.
What files did you copy to the machine you are running the application on? I always recommend copying the complete solution and creating a shortcut to the EXE file. The guarantees you get everything to avoid the incomplete solution and also guarantees compliance with the licensing.