Indeed, I think we can. But clients can still specify kinds if they want, right? Or authors? That would make sense -- although relays are free to ignore filters they don't support.

Do you want to rewrite the NIP with these changes and send a PR? If not I can try myself later.