Can carbon monoxide leak from turned off wall furnace?

Did you turn off the thermostat or the gas valve at the bottom of the furnace? If your furnace has a pilot light then you may Still have a burning flame that should be exhausting through the flue pipe but for safety sake have your gas company check it out.