User blog comment:TombRaiser/Dragonborn: Hidden Landmarks/@comment-173.85.67.32-20121215050413/@comment-4787430-20121215051144

Yes, you'll be able to fast travel to the markers once it's discovered. You can even have a dragon travel to the location once it's been disovered, though, the dragon will just circle around the area.