There's a massive difference the demographics of south west London and other areas of the city - it's very much the old money / super desirable part of town, and has been for years.
Basically think Alderley Edge levels of wealth, with the income being used on investments / second third / fourth homes rather than Bentleys and Dubai.