I... would too? Startups take over your life, and so does taking care of young kids. Pretty hard to do both at the same time. Not impossible, but pretty hard, which is presumably why he said he’d be reluctant, not absolutely unwilling.
Leaving aside that there are driven people who work their asses off despite having young children, and that "startups consume your life" is the kind of belief VC have an interest in perpetuating, note that Graham in this statement is treating kids as a women's issue.