You can distribute macOS apps without going through the App Store.
https://developer.apple.com/macos/distribution/
For iOS, not sure, maybe it’s possible, but not realistic. Even all the Damus developers who is not Will has to jump through hurdles to get the app built onto their iPhones because of certificate issues. Most of us just work through the simulator.