He clearly didn't want to get rid of the gun. He had plenty of time and opportunity to ditch the gun if he wanted to. Personally, I suspect he had more targets in mind and kept the gun because he anticipated using it again.