In the latest report by the Census Bureau, building permits dropped to a seasonally adjusted annual rate of 1.393 million in May, the lowest level in nearly five years.