That's quite okay. I'm a little more forgiving in that regard than I was several years back, though.
I guess this could be a generational thing, or a predispositional thing: you'd have the chutzpah to remember the littlest detail with something you're definitely into (i.e, in my case: metal music; in @DragonFlames' case: JRPGs, for instance), and that quality sticks for that interest alone, you're not as observant of the littlest facts outside your interest.
Teehee