Racism comes with a whole bunch of history and context attached. It's about the power structures surrounding the argument around skin colour.

When people are 'racist' towards white people, they're just being prejudiced against their skin colour. This isn't the same as reverse racism - but it's equally stupid.

White people are racist. BIPOC are prejudiced. The difference is a semantic one, both are harmful to the discourse.