That's what my readers and commenters are for - holding me to account. Whether it comes from a place of being offended or from a place of blissful dispassion isn't really anything I really factor into things. Disagreement and debate, whatever the motivation of the commenter, often help to solidify and draw out the essence of the piece - and give people more clarity around my thoughts and the thoughts of those who read me.
I do care about the wellbeing of humanity generally, but I don't take responsibility for the internal processes of those who read my words. I used to think about who might be offended and what the repercussions might be to my phrasing - but that's the quickest way to get intellectual and literary paralysis. Now I write what I want - and if contrition/negotiation is needed, then it'll happen in the comments section.
That's why you don't need to worry about pushing back at someone who doesn't believe in safe-spaces. The absence of offence makes the conversation rewarding and the safeness comes not from limitation, but from the lack of limitation and a separation of emotion from reason.