is this even doable with the app closed?

Honestly.... I would use it that way even if it needs the app open.

I remember in the past, apps use to "play music" to remain in the backgruond. not sure which phone OS was that though. maybe Windows Phone.