{"id":641506,"date":"2013-02-06T22:00:40","date_gmt":"2013-02-07T03:00:40","guid":{"rendered":"http:\/\/gigaom.com\/?p=608132"},"modified":"2013-02-06T22:00:40","modified_gmt":"2013-02-07T03:00:40","slug":"why-big-data-matters-and-data-ism-doesnt","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/641506","title":{"rendered":"Why big data matters and data-ism doesn\u2019t"},"content":{"rendered":"<p>There has been something of a data backlash happening lately, and I think I\u2019ve figured out why: Data for the sake of data has a tendency to sanitize experiences we\u2019d rather leave a little bit dirty. But there\u2019s a big, meaningful difference that\u2019s worth knowing between <em>big data\u00a0<\/em>and <em>just plain data.<\/em><\/p>\n<p>David Brooks\u2019s recent column in the <em>New York Times<\/em> is a good example of this. He <a href=\"http:\/\/www.nytimes.com\/2013\/02\/05\/opinion\/brooks-the-philosophy-of-data.html?_r=0\">coined the term \u201cdata-ism\u201d<\/a> (which is quite apt) to describe a newfound penchant for reducing everything in our worlds into a number or statistic. Skeptical of this data worship, he is \u2014 rightfully \u2014 inclined to rebel.<\/p>\n<p>But everything Brooks mentions in his article is really just statistics, the stuff academicians and businesspeople have been doing for years. It doesn\u2019t take any revolutionary technological advances to measure the effect of political spending on campaign results or the idiosyncrasies in how a president speaks. At the best, these types of analyses are enlightening; at the worst, they\u2019re overkill.<\/p>\n<h2 id=\"data-can-be-an-unwelcome-disin\">Data can be an unwelcome disinfectant<\/h2>\n<p>Like Brooks\u2019 pointer to a study about whether there\u2019s such a thing as hot hand in basketball. Or a recent debate (that got an incredible amount of undeserved digital ink <a href=\"http:\/\/deadspin.com\/5975490\/h-y-and-z-as-concealed-weapons-we-apply-google+inspired-math-to-scrabbles-flawed-points-system\">from Deadspin<\/a> and <a href=\"http:\/\/www.roughtype.com\/?p=2499\">Nick Carr<\/a>) about whether to adjust the points and frequency of Scrabble tiles based on what letters actually appear most in the English language. Right or wrong, who cares?<\/p>\n<p>Unless you\u2019re a professional gambler or in the sports business, sports are supposed to be fun; an escape from reality. Buying into things like hot hands, sweet spots, <a href=\"http:\/\/en.wikipedia.org\/wiki\/Curse_of_the_Billy_Goat\">ancient curses<\/a> and <a href=\"http:\/\/books.google.com\/books?id=uTu6L3c_YZQC&#38;pg=PA118&#038;%2338;lpg=PA118&#038;%2338;dq=dave+barry+%22concern+rays%22&#038;%2338;source=bl&#038;%2338;ots=_dLKWvUFix&#038;%2338;sig=fLxSgDYeJiZG2NlyCLXYeiJOvT8&#038;%2338;hl=en&#038;%2338;sa=X&#038;%2338;ei=wgkTUYbuA4i8iwLNzYCADQ&#038;%2338;ved=0CC0Q6AEwAA%23v=onepage&#038;%2338;q=dave%20barry%20%22concern%20rays%22&#038;%2338;f=false\">concern rays<\/a> (thanks, Dave Barry) are part of the rooting experience. If it wasn\u2019t for <a href=\"http:\/\/sports.espn.go.com\/espn\/page2\/story?page=easterbrook%2F090922&#38;sportCat=nfl\">coaches\u2019 insistence on punting on fourth down<\/a>, I could watch an entire football game and not think about probabilites once.<\/p>\n<p>As for Scrabble, well, it\u2019s a game and it\u2019s fun. People like it as it is. What\u2019s next, lobbying to change the distribution of resource cards in Settlers of Catan to account for the relative value of each given recent drought conditions?<\/p>\n<p> <span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" type=\"text\/html\" width=\"604\" height=\"370\" src=\"http:\/\/www.youtube.com\/embed\/h8Kgjid4-u0?version=3&#38;rel=1&#038;%2338;fs=1&#038;%2338;showsearch=0&#038;%2338;showinfo=1&#038;%2338;iv_load_policy=1&#038;%2338;wmode=transparent\" frameborder=\"0\"><\/iframe><\/span> <\/p>\n<p>Likewise, while Max Levchin\u2019s vision of the future recently <a href=\"http:\/\/www.roughtype.com\/?p=2718\">had Nick Carr concerned about big brother<\/a> (read my colleague <a href=\"http:\/\/gigaom.com\/2013\/02\/01\/the-increasingly-blurry-line-between-big-data-and-big-brother\/\">Mathew Ingram\u2019s take on it here<\/a>) my takeaway from Carr\u2019s blog post was more about the threat of a sterilized world. Human beings are not rational actors, and many of us don\u2019t want to be \u2014 regardless of what the data says. We buy enormous sodas even though we don\u2019t finish them, we demand all-you-can-eat data plans <a href=\"http:\/\/www.engadget.com\/2012\/09\/28\/npd-android-users-chew-average-870mb-of-cellular-data-per-month\/\">even though we don\u2019t consume that much data<\/a> and, directly addressing one of Levchin\u2019s predictions, I bet many of us would willingly pay more for flat-rate auto insurance even if utility-style billing based on our real-time driving behavior would save us money.<\/p>\n<p>Reducing the things we like \u2014 watching sports, eating, web surfing, driving \u2014 to data points ruins the experience of living carefree and exposes our optimistic anything-can-happen attitudes to a cold, surgical light. If I thought these were the pinnacle of data\u2019s achievements, I\u2019d rebel, too.<\/p>\n<h2 id=\"datas-real-promise-is-innovati\">Data\u2019s real promise is innovation<\/h2>\n<p>Thankfully, however, I\u2019ve been lucky enough to spend my days speaking with some of the smartest data minds around and covering some truly revolutionary technologies. If there\u2019s one thing I\u2019ve learned, it\u2019s that the real value of data isn\u2019t just in uncovering statistical realities, but in finding methods for doing so where it was hitherto impossible and in creating entirely new products that change the way we interact with our world.<\/p>\n<p>Big data is a technological revolution centered around <a href=\"http:\/\/gigaom.com\/2012\/02\/06\/what-it-really-means-when-someone-says-hadoop\/\">collecting, storing and processing<\/a> more data <a href=\"http:\/\/gigaom.com\/2012\/08\/13\/geospatial-big-data-startup-spacecurve-nets-another-3-5m\/\">of more types<\/a> than ever before. It\u2019s also about doing all this stuff faster than ever before <a href=\"http:\/\/gigaom.com\/2012\/12\/06\/how-telcos-are-using-big-data-to-set-prices-and-maybe-make-bills-better\/\">as data streams in<\/a> from sensors, servers, Twitter, web surfing and however else we\u2019re generating data. Data scientists are <a href=\"http:\/\/gigaom.com\/2012\/09\/17\/5-ideas-to-help-everyone-make-the-most-of-big-data\/\">thinking up clever ways to stitch this data together<\/a>, apply statistical techniques and do all sorts of things. They\u2019re <a href=\"http:\/\/gigaom.com\/2013\/01\/29\/you-might-also-like-to-know-how-online-recommendations-work\/\">optimizing commerce<\/a>, <a href=\"http:\/\/gigaom.com\/2012\/07\/20\/hey-los-angeles-xerox-thinks-it-can-clear-traffic-on-i-10\/\">clearing traffic<\/a>, <a href=\"http:\/\/gigaom.com\/2012\/05\/02\/how-climate-corp-is-pitting-big-data-against-mother-nature\/\">insuring against inclement weather<\/a> and even <a href=\"http:\/\/gigaom.com\/2013\/01\/16\/has-ayasdi-turned-machine-learning-into-a-magic-bullet\/\">detecting genetic markers<\/a> that might lead to a cure for cancer.<\/p>\n<div id=\"attachment_608305\" class=\"wp-caption aligncenter\" style=\"width: 718px\"><a href=\"http:\/\/gigaom2.files.wordpress.com\/2013\/02\/climate_ch3-1_v2-1.jpg\"><img loading=\"lazy\" decoding=\"async\" alt=\"Climate Corporation's policies are based on some incredible data science.\" src=\"http:\/\/gigaom2.files.wordpress.com\/2013\/02\/climate_ch3-1_v2-1.jpg?w=708&#038;h=298\" width=\"708\" height=\"298\" class=\"size-large wp-image-608305\"><\/a><\/p>\n<p class=\"wp-caption-text\">Climate Corporation\u2019s policies are based on some incredible data science.<\/p>\n<\/div>\n<p>If you want to hear a lot more about what\u2019s possible, come to our <a href=\"http:\/\/event.gigaom.com\/structuredata\/?utm_source=data&#38;utm_medium=editorial&#038;%2338;utm_campaign=intext&#038;%2338;utm_term=608132+why-big-data-matters-and-data-ism-doesnt&#038;%2338;utm_content=dharrisstructure\">Structure: Data conference<\/a> March 20-21 in New York.<\/p>\n<p>Yes, there\u2019s some value to what David Brooks calls data-ism \u2014 there\u2019s a lot to be learned simply from monitoring new data sources, and a renewed focus on visualization means interesting data is now presented in ways that <a href=\"http:\/\/gigaom.com\/2013\/01\/31\/data-for-dummies-5-data-analysis-tools-anyone-can-use\/\">anyone can and might actually want to digest<\/a>. But the real reason people are, or should be, excited about data is the promise of <a href=\"http:\/\/gigaom.com\/2013\/01\/02\/why-big-data-might-be-more-about-automation-than-insights\/\">doing important things faster and better<\/a> than previously possible (where those things were even possible before).<\/p>\n<p>Talk to me when you\u2019re able to predict a flu outbreak in real time based on <a href=\"http:\/\/gigaom.com\/2012\/11\/18\/why-better-traffic-data-means-more-than-just-a-faster-commute\/\">automobile traffic patterns<\/a>, <a href=\"http:\/\/gigaom.com\/2012\/01\/02\/12-smart-grid-startups-to-watch-in-2012\/\">smart grid data<\/a> on heater usage and an <a href=\"http:\/\/gigaom.com\/2011\/07\/07\/can-you-crowdsource-health-information-via-twitter\/\">uptick in illness references on Twitter<\/a>. If you just wanna tell me that, statistically speaking, chicken soup doesn\u2019t actually appear to affect the longevity of the common cold, well, I think I\u2019ll pass. Chicken soup makes me feel better.<\/p>\n<p><em>Feature image courtesy of <a href=\"http:\/\/www.shutterstock.com\/gallery-212179p1.html\">Shutterstock user Jirsak<\/a>.<\/em><\/p>\n<p> <img loading=\"lazy\" decoding=\"async\" alt=\"\" border=\"0\" src=\"http:\/\/stats.wordpress.com\/b.gif?host=gigaom.com&#038;blog=14960843&#038;%23038;post=608132&#038;%23038;subd=gigaom2&#038;%23038;ref=&#038;%23038;feed=1\" width=\"1\" height=\"1\" \/><\/p>\n<p><a href=\"http:\/\/pubads.g.doubleclick.net\/gampad\/jump?iu=\/1008864\/GigaOM_RSS_300x250&#038;sz=300x250&#038;%23038;c=899656\"><img decoding=\"async\" src=\"http:\/\/pubads.g.doubleclick.net\/gampad\/ad?iu=\/1008864\/GigaOM_RSS_300x250&#038;sz=300x250&#038;%23038;c=899656\" \/><\/a><\/p>\n<p><strong>Related research and analysis from GigaOM Pro:<\/strong><br \/>Subscriber content. <a href=\"http:\/\/pro.gigaom.com\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=608132+why-big-data-matters-and-data-ism-doesnt&#038;utm_content=dharrisstructure\">Sign up for a free trial<\/a>.<\/p>\n<ul>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/03\/a-near-term-outlook-for-big-data\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=608132+why-big-data-matters-and-data-ism-doesnt&#038;utm_content=dharrisstructure\">A near-term outlook for big data<\/a><\/li>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/09\/listening-platforms-finding-the-value-in-social-media-data\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=608132+why-big-data-matters-and-data-ism-doesnt&#038;utm_content=dharrisstructure\">Listening platforms: finding the value in social media data<\/a><\/li>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/07\/cloud-computing-and-trickle-down-analytics\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=608132+why-big-data-matters-and-data-ism-doesnt&#038;utm_content=dharrisstructure\">Cloud computing and trickle-down analytics<\/a><\/li>\n<\/ul>\n<p><img width='1' height='1' src='http:\/\/gigaom.feedsportal.com\/c\/34996\/f\/646446\/s\/28503e3f\/mf.gif' border='0'\/><\/p>\n<div class='mf-viral'>\n<table border='0'>\n<tr>\n<td valign='middle'><a href=\"http:\/\/share.feedsportal.com\/viral\/sendEmail.cfm?lang=en&#038;title=Why+big+data+matters+and+data-ism+doesn%E2%80%99t&#038;link=http%3A%2F%2Fgigaom.com%2F2013%2F02%2F06%2Fwhy-big-data-matters-and-data-ism-doesnt%2F\" ><img decoding=\"async\" src=\"http:\/\/res3.feedsportal.com\/images\/emailthis2.gif\" border=\"0\" \/><\/a><\/td>\n<td valign='middle'><a href=\"http:\/\/res.feedsportal.com\/viral\/bookmark.cfm?title=Why+big+data+matters+and+data-ism+doesn%E2%80%99t&#038;link=http%3A%2F%2Fgigaom.com%2F2013%2F02%2F06%2Fwhy-big-data-matters-and-data-ism-doesnt%2F\" ><img decoding=\"async\" src=\"http:\/\/res3.feedsportal.com\/images\/bookmark.gif\" border=\"0\" \/><\/a><\/td>\n<\/tr>\n<\/table>\n<\/div>\n<p><a href=\"http:\/\/da.feedsportal.com\/r\/151885358070\/u\/49\/f\/646446\/c\/34996\/s\/28503e3f\/a2.htm\"><img decoding=\"async\" src=\"http:\/\/da.feedsportal.com\/r\/151885358070\/u\/49\/f\/646446\/c\/34996\/s\/28503e3f\/a2.img\" border=\"0\"\/><\/a><img loading=\"lazy\" decoding=\"async\" width=\"1\" height=\"1\" src=\"http:\/\/pi.feedsportal.com\/r\/151885358070\/u\/49\/f\/646446\/c\/34996\/s\/28503e3f\/a2t.img\" border=\"0\"\/><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/OmMalik?a=nVeSJ11RCvQ:cU0ohM0YLQ4:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/OmMalik?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/OmMalik\/~4\/nVeSJ11RCvQ\" height=\"1\" width=\"1\"\/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>There has been something of a data backlash happening lately, and I think I\u2019ve figured out why: Data for the sake of data has a tendency to sanitize experiences we\u2019d rather leave a little bit dirty. But there\u2019s a big, meaningful difference that\u2019s worth knowing between big data\u00a0and just plain data. David Brooks\u2019s recent column [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-641506","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/641506","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/comments?post=641506"}],"version-history":[{"count":0,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/641506\/revisions"}],"wp:attachment":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/media?parent=641506"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/categories?post=641506"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/tags?post=641506"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}