The Federal Reserve Bank of San Francisco released a graphic Friday showing the number of single-unit housing starts against the housing stock over the past 45 years.