Indeed. Even readers had to wait to find out all the information at once. When we first met Littlefinger, for instance, we didn't know of his backstory with Cat and Ned, either. So, just be careful of jumping to the conclusion that the show is meant for the readers. We're at a different place because we have the benefit of retrospect from having read all 4 books. Doesn't mean that it's not fun for the non-book-reading viewers to find the puzzle pieces yourself.
Also, think of what fun it'd be to re-watch after the entire S1 is over. You'll be picking up these backstories just as much as the readers have.
I loved the books the first time around so I was surprised that I loved them more when I re-read them.