It’s the awkward thing about the affordability debate. Nothing makes a city cheaper faster than an economic bust.