Board Thread:Skyrim/@comment-108.57.18.192-20140601004116/@comment-9421524-20140602075125

Based on the fact they say "castle", I'd assume either Lydia and they mean Dragonsreach or Serana and they mean Volkihar. Either way, just wait for a few days and it'll say she's left your service.