The main objection to Mance writing the letter (as it is with Ramsey too) seems to be the heads on spikes reference as not being in context for a wilding (or a Bolton), but I don't recall ever finding out where in Westeros Mance lived before he took the black.