{"id":519059,"date":"2010-04-07T10:12:19","date_gmt":"2010-04-07T14:12:19","guid":{"rendered":"http:\/\/gigaom.com\/?p=111272"},"modified":"2010-04-07T10:12:19","modified_gmt":"2010-04-07T14:12:19","slug":"gizzard-anyone-twitter-offers-up-code-for-distributed-data","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/519059","title":{"rendered":"Gizzard Anyone? Twitter Offers up Code for Distributed Data"},"content":{"rendered":"

Twitter last night offered up the code for Gizzard<\/a>, an open-source framework for accessing distributed, scalable data stores quickly, which could become an important component of building out a web-based business, much like Facebook’s Cassandra project<\/a> has swept through the ranks of webscale startups<\/a> and even big companies.<\/a><\/p>\n

Gizzard is a middleware networking service that sits between the front end web site client and the database and attempts to divide and replicate data in storage in intelligent ways that allows it to be accessed quickly by the site. From the Twitter blog post:<\/p>\n

Twitter has built several custom distributed data-stores. Many of these solutions have a lot in common, prompting us to extract the commonalities so that they would be more easily maintainable and reusable. Thus, we have extracted Gizzard, a Scala framework that makes it easy to create custom fault-tolerant, distributed databases.<\/p>\n

Gizzard is a framework in that it offers a basic template for solving a certain class of problem. This template is not perfect for everyone\u2019s needs but is useful for a wide variety of data storage problems. At a high level, Gizzard is a middleware networking service that manages partitioning data across arbitrary backend datastores (e.g., SQL databases, Lucene, etc.).<\/p><\/blockquote>\n

The goal is to deliver relevant information to users faster across huge data sets that Twitter manages. Twitter said one of\u00a0 its FlockDB distributed graph database can serve 10,000 queries per second per commodity machine using Gizzard. I heard Twitter’s, Kevin Weil talk about the project a few weeks ago at SXSW<\/a>, and at the time he said the company was building something to help manage distributed data sets using a Scala framework. This appears to be exactly that.<\/p>\n

\"\"<\/a><\/p>\n

Whether or not Gizzard turns into another Cassandra or it fizzles, is open for debate, but the act of figuring out how to work with giant data sets and then sharing that information with others is an essential step in creating webscale businesses. Thus, Twitters’s decision to solve its own problem and then share it’s solution is beneficial for the startup community.<\/p>\n