You gain even more momentum from reflecting the light back into the black hole! When you absorb a photon, you gain its momentum. However, when you reflect a photon, you gain twice its momentum to account for the momentum possessed by the photon now flying away from you.
You emit photon 1. It has momentum m. It comes back blueshifted, so you get momentum km, with k > 1. You reflect that back, and you get momentum k^2m...
It's not that simple, because as you start to move away, you redshift the photons you reflect. And the alignment issues are going to be pretty severe. And if you get too much compound interest, the photons may be blue-shifted enough to kill you or damage your ship. Still, the idea is pretty slick.