A few problems with this:
When the term "others" is used in the books it has always referred to the white walkers only. The CoTF are always called the CoTF, giants are called giants. For instance when the giants do attack the wall with Mance's forces nobody in the Watch refers to them (at any time) as "others".
The description of white walkers (brief as they have been thus far) suggests that they are a seperate race; they are certainly nothing like giants, of the CoTF.
I'm not sure of what you mean by "those who walk in the light". Obviously the White Walkers have only appeared in the dark, but giants and the children are both fine with sunlight.
If you believe that the others are being guided by either Bloodraven or the children, then you have to reject the existence of Rholler and the Great Other; and the religious beliefs of the red priests who claim that the walkers are guided by a rival deity to their own.
I think your stretching creduility to claim there is strong evidence for your ideas, as they seem to contradict much of what is written in the books.