That was the thought. Norrey is there with Cregan when Jace visits, full term or late term in her pregnancy with Rickon, & they make this Pact of Ice and Fire. Or she births Rickon mid visit, when the men travel to The Wall, so they definitively know the sex of the child - heartbreak ensues, & the Pact is sealed at that point.