Board Thread:General Discussion/@comment-25187955-20141020210233/@comment-17114085-20141021194206

You can talk to the person that gave you the quest, be it Delvin or Vex, and ask to quit the job.