I had the same issue once the member count grew. What helped me most was creating a few “base roles” with shared permissions instead of managing everything individually. Also, the permission overview becomes much easier if you keep role names very specific and consistent.