Bitter cold and snow will be replaced with above-average temperatures for much of the country, forecasters say.