Every successful head coach has a big ego. But arrogance goes beyond ego. Arrogant people not only think they're superior to everyone else, but display that attitude in an overbearing or insulting manner.
Kelly is assuredly arrogant, but I think his fatal flaw is hubris. His sense of superiority goes far beyond what is warranted, and has blinded him to his own shortcomings and those of his offensive system.