If my ancestors sold slaves I'd want any statues to them removed, and any buildings dedicated to them renamed. Similarly if they were involved in other wrong-doing.
Same if I'd personally done wrong.
This isn't about inherited guilt, we all have that. This is about not putting people who have done terrible things up on a pedestal to be venerated.
There are people in our past and present who are deserving of statues and some have them - Alan Turing, Emmeline Pankhurst, etc..
But the ones of people who don't, let's remove them or put them in a museum to be properly contextualized.