Board Thread:Skyrim/@comment-100.35.204.16-20160329021747/@comment-29713684-20160422184227

You need to finish the Dawnguard questline for her to go away. She will choose to stay by your side until it is finished.