I am using Ubuntu downloaded from the Windows Store in Windows 10. It doesn't seem to be possible to use multiple terminal windows. Is the only way then to install a GUI and use this with the X server. I feel like this would defeat the point of using Ubuntu for Windows. I can imagine it working quite slowly. And I have to download 2GB of GUI.
Windows Terminal Way:
Windows Terminal is a terminal emulator for Windows 10 written by Microsoft.
This could be achieved. You need to open multiple windows of command prompt and type
ubuntu1804depending on the version you've downloaded on all the prompts. You'll get multiple terminals.
In this screenshot I have opened one "Terminal" in app and four in
You can Shift-click the Ubuntu icon to open another instance of the Ubuntu app/terminal.
Or if you have it pinned to your taskbar and it's one of the first 10 icons (e.g. 2nd icon), you could also do Windows+Shift+2 as a keyboard shortcut to open a new instance, after doing Windows+2 to open it initially.
Try using a different terminal cmd is awful, ConEmu https://conemu.github.io/ on windows works great. After you install it you can open multiple tabs or split vertical/horizontal like terminator on Linux using hotkey Ctrl+Shift+O or Ctrl+Shift+E.
Also to speed up WSL on windows (IO is so slow) There are a few tutorials out there such as https://medium.com/@leandrw/speeding-up-wsl-i-o-up-than-5x-fast-saving-a-lot-of-battery-life-cpu-usage-c3537dd03c74 (sacrifice some security tho)
I think you will love MobaXTerm. They have a free version that has all the features. Paid version gets support.
It has been my workspace for WSL for many years and I love it. It has a snappy, native XWindows system that allows you to use GUI applications if you want (I use RStudio this way, as well as Synaptic on occasion).