IPFS is 💩, ask #[6] and he will tell you all about that.

Using webtorrent with magnet uris shared over nostr seems the way to go.