Board Thread:Consensus Track/@comment-184.97.115.167-20150621211351/@comment-26103034-20150621213806

Did you just pull an amulet of the wall? If so, Tolfdir should come along and start talking to you soon. When he's finished, equip the amulet and cast a destruction spell at the wall where the amulet was.

If you haven't actually been told to go in yet, which you haven't if Tolfdir is in Skyrim, then you've somehow messed it up by doing this to early. Try equipping the amulet and casting a destruction spell at the wall to see if that works.