I don't think you'd be an elitist. For me, I consider Fire Emblem elitists people who hate the difficulty, the gameplay, the story, the characters, and the fanbase of Awakening and/or Fates (sometimes other games, although those are rarer); act like huge jerks whenever the topics come up, and would rather the series have died then those games exist. I admit, such a perception was probably born from reading too many comments sections, and having them blend into my head as a nebulous, starman boogeyman that usually keeps me from interacting with this fandom, but I really have bumped into people like that online.