I feel like the saying “an eye for an eye makes the while world blind” fits here.

However, also,

If you are neutral in situations of injustice, you have chosen the side of the oppressor. If an elephant has its foot on the tail of a mouse, and you say that you are neutral, the mouse will not appreciate your neutrality.

— Desmond Tutu