If you want the cat to stop, you have to stop reinforcing its behavior. One thing you can do is cover your face with the blanket immediately after it starts to swat at your face. I did this with my cat that used to do something similar and it worked.