Board Thread:Skyrim/@comment-108.220.169.79-20150531172310/@comment-6881629-20150531174524

Yielding often doesn't work you could try going to the guards in Riften they might not be so aggressive (might) or hide far away for for over ten in-game days as see if they calm down a bit and let you turn yourself in.

If you have a save before the kill you could reload and wait until he's in his shack at night then kill him stealthily.