Originally Posted by Theosis
You mean the books you buy from the merchants? Yeah you can. You might as well do them while doing your main quests though, a lot of them line up perfectly with the quest line.
I'll start doing it now, but I just wanted to make sure for the ones I missed