The area is comprised mostly of what were originally large single-family dwellings, many of which have been converted into duplexes, triplexes or rooming houses. There are some apartment buildings within the neighbourhood. There are retail and commercial areas concentrated along the arterial roads and interspersed among the homes.
The Annex is a socially diverse neighbourhood with residents who are very poor (such as students and recent immigrants) living next to the very wealthy.