I feel like that's a bad idea. If they were able to track your IP address, then they could potentially find out where you live or work and harm you physically or otherwise. You should definitely report them and their harassment, but I would not recommend engaging with them directly in any way.