You've misunderstood the premise of 'public interest' - as opposed to being interested in the outcome. Information in the public interest is about "the welfare or well-being of the general public" and society. If someone is a rapist (ie convicted) then it is definitely in the public interest to know. It is not in the public interest to make accusations - I'd argue that it destabilises the general public.
We shouldn't be hearing about the man on the street either. This isn't about differentiating between celebrities and everyday men - it's about getting a process right. Society would be much better off if these accusations and full investigations were handled away from the public. I've gone into why in the article I linked - that was a messy case, but it illustrates quite nicely the wider point about the public generally making things worse for both the accuser and the accused.
If an accusation goes to court and people are found to be guilty then it should be published - being a celeb shouldn't allow you to pay off anyone. It is the public nature of the accusations that bring in pay-offs. If you can be paid off then your integrity can be called into question. That's what's happening there. The first you should hear about it is 'Sean Coombs was found guilty of sexual assault and is sentenced to 10 years in prison'. At that point you can absolutely go to town on him.
I don't think feminism is the problem - but I do think we've got to be careful about how we handle legal rights. The right to live without harassment has to be balanced with the right to a fair trial. If we get it wrong then feminism generally suffers. I've made that case before too after the shit-show between Depp and Heard. You can find it here. https://medium.com/p/c0ec43ff7a52