Here they explain how to package an app for umbrel https://github.com/getumbrel/umbrel-apps and you can browse existing apps and see how their docker-compose.yml is specified.