Building permits fell 5.4% in January to a seasonally adjusted annual rate of 1.376 million, falling short of the forecast of 1.420 million.