Based on the experiences we had we our three kids, I would suggest a balance bike is by far the best way to start.

Gets the balancing/steering stuff out of the way and you have all the control of speed you need (as long as it's not too steep!) with the feet.