Yeah there’s a number of ways you can expand the set without just pulling in any random bot/spam account. One that is used by a client (can’t remember atm) is “follows of people I follow.”

You branch out one or two steps removed from your group and you still benefit from a social weighting, while also pulling for a vastly larger group of posts. But there are probably more clever ways to mitigate similar issues that others will think of.