If you have more houses than you have population, your citizens will move into the best-placed houses on the map and leave the others vacant. You can either recycle the house and rebuild it when your population increases, or work to increase you population to fill the house.