I was trying to learn to do something like this before, could you provide reference material by chance?
Discussion
Here they explain how to package an app for umbrel https://github.com/getumbrel/umbrel-apps and you can browse existing apps and see how their docker-compose.yml is specified.
This is great! That ks!