Huh, it looks like something like this might be happening in the next Thor movie with the Grandmaster.

And I just found this little tidbit - "Later, having returned to the 20th Century, the Grandmaster used Daredevil and the Defenders as his pawns against Doctor Doom‘s artificial creation the Prime Mover. Winning this match he decided to take control of the Earth as a breeding ground for superhuman-powered pawns for his games, but gave up the Earth after losing a bet with Daredevil."

http://marvel.com/universe/Grandmaster#ixzz4Adj0lRCk