If I understand correctly, the issue is that a client only communicates with one member of the federation, making it all a larp. ie. an invoice is generated by a single fed provider.

I don't know much about the fedimint process but it sounds like you just have to have all of the custodians sign the invoice to attest to it's validity before trusting it? I'm a little surprised if they don't already do something like that though.