Sad the amount of technological progress we may be missing out on by this, I rarely see it discussed but I think fertility is important in order for society to be able to maintain a steady course of improvement in science and technology.
The number of individuals with the potential of Albert Einstein (to pick a stereotype) in a given country is not correlated to the total number of people. Standard of living, a stable childhood environment, quality of schooling, modern medicine, economic opportunity, sanitation, are more important to nurture future innovators. A kid working the fields in Angola will probably never reach his full potential, but little Johnny from suburban America probably will.