Seems like Gitlab runner would be a better choice if you need that kind of functionality. Gitlab has good self-hosting support.

Keep up the great work and be careful of feature creep. I love that the apps under 10MB right now!