{"id":647899,"date":"2013-03-20T19:11:50","date_gmt":"2013-03-20T23:11:50","guid":{"rendered":"http:\/\/gigaom.com\/?p=622638"},"modified":"2013-03-20T19:11:50","modified_gmt":"2013-03-20T23:11:50","slug":"six-ideas-from-entrepreneurs-for-solving-your-big-data-problems","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/647899","title":{"rendered":"Six ideas from entrepreneurs for solving your big-data problems"},"content":{"rendered":"<p>Entrepreneurs from six big data startups took the stage Wednesday at <a href=\"http:\/\/event.gigaom.com\/structuredata\/?utm_source=data&#38;utm_medium=editorial&#038;%2338;utm_campaign=intext&#038;%2338;utm_term=622638+six-ideas-from-entrepreneurs-for-solving-your-big-data-problems&#038;%2338;utm_content=gigajordan\">GigaOM\u2019s Structure:Data<\/a> conference to share insights on the industry as a whole. Taken together, one gets a sense of the ideal way to crunch big data in an enterprise or any other organization with large data sets on their hands.<\/p>\n<ul>\n<li>Just because you have a lot of data doesn\u2019t mean you\u2019re doing a good job of acting on it. Numenta CEO Rami Branitzky made the point with an example. Data scientists working at utility companies might act on just 0.5 percent of data, and it might take them three weeks to build a model, let alone deploy it. A better solution, Branitzky said, would derive insights immediately as fast as data streams come in, just as the brain processes information pretty much as soon as a person captures it through the five senses.<\/li>\n<li> Sure, Hadoop is hip and hefty \u2014 just ask my colleague Derrick Harris, who recently wrapped up <a href=\"http:\/\/gigaom.com\/2013\/03\/12\/hadoops-past-present-and-future-a-gigaom-special-report\/\">a four-part series<\/a> on it \u2014 but it ain\u2019t necessarily easy for statistics-savvy data scientists familiar with quick and dirty programming languages such as Python to wrangle data with Hadoop in Java, said Doug Daniels, chief technology officer of Mortar Data. Hence the company\u2019s offering of Hadoop available for deployment through Python, which could make more sense for certain customers.<\/li>\n<li> Airlines have modernized pilot dashboards over the years, although multiple iterations haven\u2019t necessarily added more new measurements for pilots to keep track of, said Stephen Messer, co-founder and vice chairman of Collective[i]. Instead, the companies put right in front of pilots\u2019 eyes the information most relevant to them at any given moment. \u201cIs this the best technology out there? No. It\u2019s taking existing technology and reutilizing it,\u201d Messer said. Similarly, his company seeks to give customers existing technology that\u2019s easily accessible and therefore very powerful.<\/li>\n<li> Asking questions of your data is only effective if you know the right questions to ask. But what if you don\u2019t? Arijit Sengupta, CEO of BeyondCore, showed off his company\u2019s answer to that question \u2014 software that quickly computes thousands of options based on all available variables to show charts and actually talks to you to identify the biggest drivers of, say, profit.<\/li>\n<li> The number of \u201copen-data APIs\u201d that can provide data freely to the public has grown in the past five or six years from fewer than 100 to more than 8,000, said Sharmila Shahani-Mulligan, founder and CEO of ClearStory Data. Companies should be able to take advantage of all that publicly available sets by easily crossing it with privately held data to draw new insights, she said.<\/li>\n<li> As Ayasdi Co-founder and CEO Gurjeet Singh sees it, the popular word \u201cinsight\u201d should have a commonly accepted definition. He proposed one: an actionable truth about a problem discovered from data. By \u201cactionable,\u201d he meant that it should be compact, because otherwise it\u2019s unlikely that anyone will act on it. Regarding \u201ctruth,\u201d it can\u2019t be random. \u201cIn large data sets, it\u2019s easy to find whatever you want to find.\u201d There must be statistical proof bearing out a theory. And it must be \u201cdiscovered\u201d as a result of a customer\u2019s questions. <\/li>\n<\/ul>\n<p>Check out the rest of our Structure:Data 2013 coverage here, and a video embed of the session follows below:<\/p>\n<p> <iframe loading=\"lazy\" src=\"http:\/\/new.livestream.com\/accounts\/74987\/events\/1927733\/videos\/14322734\/player?autoPlay=false&#38;height=360&#038;%2338;mute=false&#038;%2338;width=640\" width=\"640\" height=\"360\" frameborder=\"0\" scrolling=\"no\"><\/iframe> <br \/> <img loading=\"lazy\" decoding=\"async\" alt=\"\" border=\"0\" src=\"http:\/\/stats.wordpress.com\/b.gif?host=gigaom.com&#038;blog=14960843&#038;%23038;post=622638&#038;%23038;subd=gigaom2&#038;%23038;ref=&#038;%23038;feed=1\" width=\"1\" height=\"1\" \/><\/p>\n<p><a href=\"http:\/\/pubads.g.doubleclick.net\/gampad\/jump?iu=\/1008864\/GigaOM_RSS_300x250&#038;sz=300x250&#038;%23038;c=203038\"><img decoding=\"async\" src=\"http:\/\/pubads.g.doubleclick.net\/gampad\/ad?iu=\/1008864\/GigaOM_RSS_300x250&#038;sz=300x250&#038;%23038;c=203038\" \/><\/a><\/p>\n<p><strong>Related research and analysis from GigaOM Pro:<\/strong><br \/>Subscriber content. <a href=\"http:\/\/pro.gigaom.com\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=622638+six-ideas-from-entrepreneurs-for-solving-your-big-data-problems&#038;utm_content=gigajordan\">Sign up for a free trial<\/a>.<\/p>\n<ul>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/04\/infrastructure-q1-cloud-and-big-data-woo-the-enterprise\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=622638+six-ideas-from-entrepreneurs-for-solving-your-big-data-problems&#038;utm_content=gigajordan\">Infrastructure Q1: Cloud and big data woo enterprises<\/a><\/li>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/09\/listening-platforms-finding-the-value-in-social-media-data\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=622638+six-ideas-from-entrepreneurs-for-solving-your-big-data-problems&#038;utm_content=gigajordan\">Listening platforms: finding the value in social media data<\/a><\/li>\n<li><a href=\"http:\/\/pro.gigaom.com\/2012\/05\/the-importance-of-putting-the-u-and-i-in-visualization\/?utm_source=data&#038;utm_medium=editorial&#038;utm_campaign=auto3&#038;utm_term=622638+six-ideas-from-entrepreneurs-for-solving-your-big-data-problems&#038;utm_content=gigajordan\">The importance of putting the U and I in visualization<\/a><\/li>\n<\/ul>\n<p><img width='1' height='1' src='http:\/\/gigaom.feedsportal.com\/c\/34996\/f\/646446\/s\/29cd8264\/mf.gif' border='0'\/><\/p>\n<div class='mf-viral'>\n<table border='0'>\n<tr>\n<td valign='middle'><a href=\"http:\/\/share.feedsportal.com\/viral\/sendEmail.cfm?lang=en&#038;title=Six+ideas+from+entrepreneurs+for+solving+your+big-data+problems&#038;link=http%3A%2F%2Fgigaom.com%2F2013%2F03%2F20%2Fsix-ideas-from-entrepreneurs-for-solving-your-big-data-problems%2F\" ><img decoding=\"async\" src=\"http:\/\/res3.feedsportal.com\/images\/emailthis2.gif\" border=\"0\" \/><\/a><\/td>\n<td valign='middle'><a href=\"http:\/\/res.feedsportal.com\/viral\/bookmark.cfm?title=Six+ideas+from+entrepreneurs+for+solving+your+big-data+problems&#038;link=http%3A%2F%2Fgigaom.com%2F2013%2F03%2F20%2Fsix-ideas-from-entrepreneurs-for-solving-your-big-data-problems%2F\" ><img decoding=\"async\" src=\"http:\/\/res3.feedsportal.com\/images\/bookmark.gif\" border=\"0\" \/><\/a><\/td>\n<\/tr>\n<\/table>\n<\/div>\n<p><a href=\"http:\/\/da.feedsportal.com\/r\/161393635924\/u\/49\/f\/646446\/c\/34996\/s\/29cd8264\/a2.htm\"><img decoding=\"async\" src=\"http:\/\/da.feedsportal.com\/r\/161393635924\/u\/49\/f\/646446\/c\/34996\/s\/29cd8264\/a2.img\" border=\"0\"\/><\/a><img loading=\"lazy\" decoding=\"async\" width=\"1\" height=\"1\" src=\"http:\/\/pi.feedsportal.com\/r\/161393635924\/u\/49\/f\/646446\/c\/34996\/s\/29cd8264\/a2t.img\" border=\"0\"\/><\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/OmMalik?a=ZAkmOi87sBY:7OGjaEjkTKI:yIl2AUoC8zA\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/OmMalik?d=yIl2AUoC8zA\" border=\"0\"><\/img><\/a>\n<\/div>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/OmMalik\/~4\/ZAkmOi87sBY\" height=\"1\" width=\"1\"\/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Entrepreneurs from six big data startups took the stage Wednesday at GigaOM\u2019s Structure:Data conference to share insights on the industry as a whole. Taken together, one gets a sense of the ideal way to crunch big data in an enterprise or any other organization with large data sets on their hands. Just because you have [&hellip;]<\/p>\n","protected":false},"author":7463,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-647899","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/647899","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/users\/7463"}],"replies":[{"embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/comments?post=647899"}],"version-history":[{"count":0,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/posts\/647899\/revisions"}],"wp:attachment":[{"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/media?parent=647899"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/categories?post=647899"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mereja.media\/index\/wp-json\/wp\/v2\/tags?post=647899"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}