As someone pointed out, chess isn't even an Olympic sport. Chess is a sport, and it's one of the most difficult things in the world to master. If call of duty got into the Olympics over chess (or you know... And GOOD game) I'd hang myself.
Seriously tho, video games have no place in the Olympics. There is no physical athleticism involved. Do video games require skill, and lots of practice? Of course they do, but they just don't fit the bill as an Olympic sport in the same way that tennis wouldn't fit in ESEA. esports is growing, but it has a LONG way to go. The Koreans have really paved the way for us with the Starcraft scene, if we could reach that level with other games we could see esports finally get recognized as a legit "sport", but even then it still wouldn't fit the bill for the Olympics.