If your stuck on windows, give MobaXterm a try. It's the commandline Windows should have had.

Sorry, but I don't think there is anything you can do about the GUI..

I like to use x2go on another machine or VM, it gives you access to individual windows/tiles for Linux programs, similar to Citrix published apps.