Board Thread:Skyrim/@comment-112.211.211.63-20130326060456/@comment-4787430-20130326061002

Unfortunately, you can't get rid of them if you sided with the vampires.

Only console commands can remove the scrolls.