WeatherWhys for November 20,2013 from accuweather.com

The chimney downdraft is caused by the difference in pressure between the outside air and inside air, which is lower. Air is naturally drawn from higher to lower pressure. This downdraft can make it difficult to start a fire. One way to counteract this is to open a window when starting the fire to balance out the pressure.