In that case you’d likely be better off using a Linux based OS, on the basis that Windows uses a lot more RAM and disk space than Linux, and those things are going to contribute to the cost of the VPS you buy.
You can run Firefox, Chromium, etc. on Linux distrubtions with no issues.
Might be worth looking at something like Ubuntu 20.04 with XFCE Desktop and TightVNC.