Without followers they’re loan wolves.

Followers follow until they can’t be led any further, so I wouldn’t say they’re prisoners but I’m sure leaving a cult is harder than entering.