It could be that the ranking prior to the swap is continuing to have some lasting effect on the sites after the swap. It would be worth doing the same test on new domains (with new content), to be sure there weren't any side effects from the swap itself.