{"id":644820,"date":"2013-03-01T15:01:41","date_gmt":"2013-03-01T20:01:41","guid":{"rendered":"http:\/\/www.webpronews.com\/?p=219614"},"modified":"2013-03-01T15:01:41","modified_gmt":"2013-03-01T20:01:41","slug":"google-posts-big-search-quality-rating-guidelines-document-says-its-just-the-cliffs-notes-version-of-the-real-thing","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/644820","title":{"rendered":"Google Posts Big \u2018Search Quality Rating Guidelines\u2019 Document, Says It\u2019s Just The \u2018Cliffs Notes\u2019 Version Of The Real Thing"},"content":{"rendered":"<p>We&#8217;ve seen Google&#8217;s search quality raters referenced numerous times, but now Google has made available the whole set of guidelines in <a href=\"http:\/\/static.googleusercontent.com\/external_content\/untrusted_dlcp\/www.google.com\/en\/us\/insidesearch\/howsearchworks\/assets\/searchqualityevaluatorguidelines.pdf\">one giant PDF<\/a> for your perusal. The document is called &#8220;Search Quality Rating Guidelines,&#8221; and interestingly, it&#8217;s labeled version 1.0, and is dated November 2012. It was released as part of <a href=\"http:\/\/www.webpronews.com\/google-gives-you-a-closer-look-at-how-search-works-2013-03\">Google&#8217;s new &#8220;How Search Works&#8221; site<\/a>. <\/p>\n<p>&#8220;Google relies on raters, working in countries and languages around the world, to help us measure the quality of our search results, ranking, and search experience,&#8221; Google explains. &#8220;These raters perform a variety of different kinds of \u201crating tasks\u201d designed to give us information about the quality of different kinds of results in response to different kinds of queries. The data they generate is rolled up statistically to give us within the Google search team a view of the quality of our search results and search experience over time, as well as an ability to measure the effect of proposed changes to Google\u2019s search algorithms. Raters\u2019 judgments do not directly impact Google\u2019s search result rankings. While a rater may give a particular URL a score, that score does not directly increase or decrease a given website\u2019s ranking. Instead these scores are used in aggregate to evaluate search quality and make decisions about changes.&#8221;<\/p>\n<p>In the preface of the document, Google notes that the document itself is not the entire version that raters actually use on a daily basis, but rather a &#8220;Cliffs Note&#8221; version. <\/p>\n<p>&#8220;The raters\u2019 version includes instruction on using the rating interface, additional rating examples, etc.,&#8221; Google explains. &#8220;These guidelines are used as rating specifications for search raters, and this document in particular focuses on a core type of rating task called &#8216;URL  rating.&#8217; In a URL rating task, a rater is shown a search query from their locale (country + language) and a URL that could be returned by a search engine for that query. The raters &#8216;rate&#8217; the quality of that result for that query, on a scale described within the document. Sounds simple, right? As you\u2019ll see, there are many cases to think through, and this document is used to guide raters on some of those cases and how to look at them.&#8221;<\/p>\n<p>In a Webmaster Help video released this past October, Matt Cutts also discussed the quality raters&#8217; &#8220;impact&#8221; on algorithms. <\/p>\n<p><center><iframe loading=\"lazy\" width=\"616\" height=\"347\" src=\"http:\/\/www.youtube.com\/embed\/881l9EeynJs\" frameborder=\"0\" allowfullscreen><\/iframe><\/center><\/p>\n<p>Here&#8217;s another one they put out in May talking about how Google uses the human raters: <\/p>\n<p><center><iframe loading=\"lazy\" width=\"616\" height=\"347\" src=\"http:\/\/www.youtube.com\/embed\/nmo3z8pHX1E\" frameborder=\"0\" allowfullscreen><\/iframe><\/center><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:wF9xT3WuBAs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?i=w5XtRI6NSuA:rEkIwFWwqb4:wF9xT3WuBAs\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:7Q72WNTAKBA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?d=7Q72WNTAKBA\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:V_sGLiPBpWU\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?i=w5XtRI6NSuA:rEkIwFWwqb4:V_sGLiPBpWU\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:qj6IDK7rITs\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?d=qj6IDK7rITs\" border=\"0\"><\/img><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?a=w5XtRI6NSuA:rEkIwFWwqb4:mfZ73u_VV2s\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/webpronews\/all?i=w5XtRI6NSuA:rEkIwFWwqb4:mfZ73u_VV2s\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/webpronews\/all\/~4\/w5XtRI6NSuA\" height=\"1\" width=\"1\"\/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We&#8217;ve seen Google&#8217;s search quality raters referenced numerous times, but now Google has made available the whole set of guidelines in one giant PDF for your perusal. The document is called &#8220;Search Quality Rating Guidelines,&#8221; and interestingly, it&#8217;s labeled version 1.0, and is dated November 2012. It was released as part of Google&#8217;s new &#8220;How [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-644820","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/644820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/comments?post=644820"}],"version-history":[{"count":0,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/644820\/revisions"}],"wp:attachment":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/media?parent=644820"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/categories?post=644820"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/tags?post=644820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}