As a fairly committed atheist I agree with you - there are moderates in most religions and those people are the best at convincing me that religion plays a valuable part in the lives of other citizens. It’s just not for me.
However, society has conflated enforcing ethical boundaries with some aspects of racism and the word ‘colonialism’ is used as a sort of dead cat strategy to get white folks to run round apologising for everything. I’m an equal opportunity bird and a liberal, so I don’t mind people holding socially regressive views for any reason…. As long as they don’t throw them into the corridors of power or sneak them into the education system then I’m fine. When you have batshit faux-liberalism folding itself into crazy shapes then I tend to get a bit ranty.