The city’s affordable housing stock is rapidly disappearing.