Searching for the optimal small network is just as much work as training a larger network. There's no free lunch.