I think there's a difference between a statue or monument put up to celebrate someone.
And something like a concert hall or school which has a separate purpose and can be renamed anyway.
I have seen and signed a petition to have the status replaced with the man of Jamaican (I think, certainly Caribbean) descent who led the famous Bristol Bus Boycott against racist pay and employment policies that was a major cause of the Race Relations Act.