*nods* I think the wizarding population had been in decline for a while. We don't know much about Grindelwald, but Voldemort had obviously been picking away at his enemies for years. Add to that the likely survival rate in the MLE, and there's a very small group involved. Even if Sirius wasn't an auror, there's a fair chance that whoever arrested him was in the Order.