With three of the best Jeopardy players ever, I thought they might make the questions a bit more challenging. I can see why this might not work in this case because Watson was programmed using regular questions. But I agree, I would have liked to see the skill level rise with the caliber of player.
A Watson that knows 70% of the answers will beat a human who knows 90% of the answers, purely due to better reflexes. Of course, buzzer skill is partly how KenJen won so many games, so I'm not complaining. Just not AS impressed by Watson as some people.
Except that it's not just reflexes. Watson has to compute the answer before the humans. That's no small task. This video is a great technical explanation of how it works:
I'm sure the same thing comes out of Jeopardy "Tournament of Champions" games where a number of very good human players come together. It's just that only regular Jeopardy watchers every noticed those games were taking place.
It just seems more pronounced with Watson because it drew in a large crowd of new (but perhaps one-time) viewers.
I don't think I realized the degree and I've been an off-and-on regular Jeopardy watcher over the years. I don't see this subtlety as hurting Jeopardy's brand any though. It does make me wish that there had been a better platform for competition of this sort that would have had a more level playing field.
(The humans actually had some advantage of anticipating the buzz-in signal so I'm not saying that Watson had all the cards. I'm just saying that a lot of the contest hinged on a factor that inherently could not be made apples-to-apples.)