User blog comment:Zippertrain85/Why the Stormcloaks are right./@comment-101.161.47.117-20130515101214/@comment-80.216.216.3-20130520234117

http://elderscrolls.wikia.com/wiki/Skyrim's_Rule

This book tells it like it is;

"The reality, however, is that the High King swears fealty to the Emperor, and as Solitude is the city most directly influenced by Imperial culture and politics, the Jarl of Solitude has served as High King for generations. The Moot, therefore, is more formality and theater than anything else.

So while the Jarls of Skyrim still control their holds, and those Jarls are ruled over by their Imperial-sanctioned High King, will there come a day when the Moot convenes to select a new High King - one that is not, as many would say, the Emperor's "Solitude puppet"?"

So, yes Torygg was definitely suspect.