I disagree - not because I'm white, but because I'm a Penguin. I'll judge whether something is X based on the intelligence and the intent of the person saying it. Skin colour is not an indicator of insight or intelligence. I will happily concede that a brown person might have more lived experience of racism, but lived experience doesn't make them correct on what is racist and what is not. And what happens if two non-white people disagree on whether something is racist or not? What then? Is one of them 'perpetuating whiteness' as a get out of jail free card? The idea that skin colour is related to intelligent argument doesn't fly with this bird, there are more intelligent conversations to be had and better forms of discussion to be had than 'the brown person is always right'.
You don't have to apologise for offending people, the 'my bad' approach allows a reductive loop to appear. I'll call it weaponised offence.... If I'm offended by what you say then you must immediately retract it is not a good way for two people to engage in a meaningful discussion. It is in fact one of my trifecta of bad faith devices. https://medium.com/lucid-nightmare/the-only-useful-response-for-i-find-that-offensive-faed4580ff3b