I've read a theory that all big ancient cities had negative population growth. Because of poor sanitation and understanding of pathogens (and other problems), diseases killed off people quicker than the birthrate. However it was made up for by constant migration from the countryside by people looking for work. I don't know if that's true, but I have heard credible people reference it.
According to this thesis[1], 40–50% of Romans were born outside the city, that sounds like quite widespread mobility!
[1] http://www.academia.edu/245988/Migration_and_Mobility_in_Imp...