The days will start getting longer from the solstice on, so the worst has passed. It will get colder than now though, so for some people that might be what they refer to when they say it's "only" starting now.