That's the collective inherited guilt which I mentioned. We can't do much about it that other than acknowledge, learn from the history, and do more going forward to stop racism and discrimination, both institutional and personal, both conscious and unconscious.
We can however remove provocative manifestations of that collective inherited guilt where they exist such as statues of slave traders.