Follow-up from "Add managing protected branches as custom permission"

The following discussions from !162208 (merged) should be addressed:

• @apennells started a discussion: (+2 comments)

  Suggestion: We should also have a test for the error alert here