I’ve always managed to get pretty good scores with Roots/Sage. Have you tried using GTMetrix? that might help you identify some areas you can improve and give a little more insight than Google Page Speed on some fronts.
Personally even on shared hosting I’ve found it’s possible to get under a second load times with fairly decent scores and on a VPS running Trellis you should have no issues.
A few pointers would be:
-
Generally a good idea to use Nginx over Apache if your host offers that.
-
Remove any Bootstrap components you are not using. More info on that
-
Dequeue Styles and Scripts you can without issue from plugins to decrease the number of requests and block rendering.
-
If you’re on shared hosting use a decent caching plugin (my personal favourite right now is WP Fastest Cache)
-
Someone integrated pagespeed with Trellis which looks awesome, I haven’t tried it yet but I plan to soon.
That’s about all I can think of right now, I hope that helps 
EDIT: I thought I’d give an example of a site I’ve recently finished for a client in the last few weeks and they are on shared hosting, and even on shared it was possible to get a decent score.
