Yep! Basically, copy this file to theme_root/config/assets.php.
As far as your other questions, I’m mostly Mac, so not the best resource on the Windows side. However, it looks like WSL is still the way for Windows. This topic seems to help clarify a bit more.