What isn't FOSS about it?

It's a lightweight Linux distro with a web UI. The full codebase for their OS is on GitHub. You can build it yourself. They even publish a detailed guide on how to do so.

Umbrel distributes FOSS software and has to make their wrappers of it FOSS too under the licenses, but their core platform isn't FOSS.