Lead does slow down sufficiently fast neutrons, by inelastic nuclear scattering. But this has a threshold (0.57 MeV); below that energy it hardly affects neutron energy at all.