{"id":419942,"date":"2010-03-12T09:06:34","date_gmt":"2010-03-12T14:06:34","guid":{"rendered":"http:\/\/knowledgeproblem.com\/?p=6568"},"modified":"2010-03-12T09:06:34","modified_gmt":"2010-03-12T14:06:34","slug":"fish-leg-counts-what-the-web-knows-and-doesn%e2%80%99t-know","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/419942","title":{"rendered":"Fish leg counts: What the web knows and doesn\u2019t know"},"content":{"rendered":"

Michael Giberson<\/em><\/p>\n

David Pennock hears another another tick of the clock in the countdown to web sentience<\/a>.<\/p>\n

[In 2003] we trained a computer to answer questions from the then-hit game show by querying Google. We combined words from the questions with words from each answer in mildly clever ways, picking the question-answer pair with the most search results. For the most part (see below), it worked.<\/p>\n

It was a classic example of \u201cbig data, shallow reasoning\u201d and a sign of the times. Call it Google\u2019s Law.\u00a0With enough data nothing fancy can be done, but more importantly nothing fancy need be done: even simple algorithms can look brilliant.<\/strong> When in comes to, say, identifying synonyms, simple pattern matching across an enormous corpus of sentences beats the most sophisticated language models developed meticulously over decades of research.<\/p>\n

Our\u00a0Millionaire<\/em> player was great at answering obscure and specific questions … It failed mostly on the warm-up questions that people find easy \u2014 the truly trivial trivia. The reason is simple. Factual answers like the year that Mozart was born appear all over web. Statements capturing common sense for the most part do not. Big data can only go so far.<\/p>\n

In 2003 their best example of a question that they could not answer via websearch was “How many legs does a fish have?<\/em>“<\/p>\n

Now<\/em>, on the other hand, Pennock said:<\/p>\n

I was recently explaining all this to\u00a0a colleague<\/a>. To make my point, we\u00a0Googled<\/a> that question.\u00a0Low and behold, there it was: asked and answered \u2014 verbatim \u2014 on Yahoo! Answers.<\/strong> How many legs does a fish have? Zero.<\/a> Apparently Yahoo! Answers\u00a0also knows<\/a> the number of legs of a crayfish, rabbit, dog, starfish, mosquito, caterpillar, crab, mealworm, and \u201cabout 133,000\u2033 more.<\/p>\n

Pennock links to Lance Fortnow’s related comments<\/a> on IBM’s effort to write a Jeopardy<\/em>-playing computer<\/a>, and Fortnow suggests something that is going to remain hard for computers for a while: making sense of natural language in context. Fortnow, part of the group that wrote the Millionaire <\/em>paper, said:<\/p>\n

Humans have little trouble interpreting the meaning of the “answers” in\u00a0Jeopardy<\/em>, they are being tested on their knowledge of that material. The computer has access to all that knowledge but doesn’t know how to match it up to simple English sentences.<\/p>\n

\"\"<\/a> \"\"<\/a> \"\"<\/a> \"\"<\/a> \"\"<\/a> \"\"<\/p>\n","protected":false},"excerpt":{"rendered":"

Michael Giberson David Pennock hears another another tick of the clock in the countdown to web sentience. [In 2003] we trained a computer to answer questions from the then-hit game show by querying Google. We combined words from the questions with words from each answer in mildly clever ways, picking the question-answer pair with the […]<\/p>\n","protected":false},"author":4109,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-419942","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/419942","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/users\/4109"}],"replies":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/comments?post=419942"}],"version-history":[{"count":0,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/419942\/revisions"}],"wp:attachment":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/media?parent=419942"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/categories?post=419942"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/tags?post=419942"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}