The solution is to use a boilerplate/generator. I've used one for every JS project I've started in the past two years.

The main benefit is that you get something that already has the whole development/test/build workflow set up, with your framework of choice. Then you can tweak things as necessary.

Since all of the processes should be able to be run through a small set of CLI commands, there isn't much mental overhead switching between projects.