(In Dr. Strangelove voice) "Of course, the whole point of a ghost gun is lost if you keep it!"
Seriously tho, the fact that he went to the trouble of obtaining one shows that he gave that some thought. But then didn't follow through. So yeah, maybe he did want to get caught.