Perfect soldier, perfect gentleman never gave offence to anyone not even the enemy.
— A. J. P. Taylor

I have the conviction that excessive literary production is a social offence.
— George Eliot

How shall I lose the sin, yet keep the sense, and love the offender, yet detest the offence?
— Alexander Pope

I think a bishop who doesn't give offence to anyone is probably not a good bishop.
— James Thomson

And where the offence is, let the great axe fall.
— William Shakespeare