Google is developing a system that will enable web publishers of any size to automatically submit new content to Google for indexing within seconds of that content being published. Search industry analyst Danny Sullivan told us today that this could be “the next chapter” for Google.
Last Fall we were told by Google’s Brett Slatkin, lead developer on the PubSubHubbub (PuSH) real time syndication protocol, that he hoped Google would some day use PuSH for indexing the web instead of the crawling of links that has been the way search engines have indexed the web for years.
Google senior product manager Dylan Casey said yesterday at Sullivan’s Search Marketing Expo in Santa Clara, California that the company plans to soon publish a standard way for site owners to participate in a program much like that.
How The System Might Work
PuSH is a syndication system based on the ATOM format where a publisher tells the world about a Hub that it will notify every time new content is published. Subscribers then tell the Hub “when this Publisher posts new content, please deliver it to me right away.” So instead of the Subscriber checking back with the Publisher all the time to see if there’s new content, they just sit and wait to be told that there is by the Hub. The Publisher publishes something, then tells the Hub that it’s available, then the Hub goes and delivers it to all the Subscribers. This can take as little as a few seconds.
If Google can implement an Indexing by PuSH program, it would ask every website to implement the technology and declare which Hub they push to at the top of each document, just like they declare where the RSS feeds they publish can be found. Then Google would subscribe to those PuSH feeds to discover new content when it’s published.
PuSH wouldn’t likely replace crawling, in fact a crawl would be needed to discover PuSH feeds to subscribe to, but the real-time format would be used to augment Google’s existing index.
As Danny Sullivan told us today, Google would have to implement some sort of spam control and not just let content be pushed live to the index unvetted. That was what happened in the earliest days of search and it was a real mess, he told us.
The Advantages of a Real Time Google Index
PuSH is much more computationally efficient for Google but Slatkin says that even more important is the impact of such a move for small publishers. Right now many small sites get visited by Google maybe once a week. With a PuSH system in place, they would be able to get their content to Google automatically right away.
A richer, faster, more efficient internet would be good for everyone, but the benefits in search wouldn’t be limited to Google, either. The PubSubHubbub is an open protocol and the feeds would be as visible to Yahoo and Bing as they would be to Google.
“I am being told by my engineering bosses to openly promote this open aproach even to our competitors,” Slatkin says. That’s a very good sign.
We expect this will be a very big deal and we’ll be covering it more extensively in the coming days, as well as whenever Google has something to announce more formally.
Don’t Forget: ReadWriteWeb recently released a big research report titled The Real-Time Web and Its Future, based on 50+ interviews with key innovators, like PubSubHubbub creator Brett Slatkin. Check it out!
Discuss

If you like 


Auto manufacturer Toyota launched a new Twitter-based portal called 



It’s not every day that a business shuts down but declares itself a success in helping kick off an unstoppable movement to change the world. 

Location based social network
A universal check-in system is the next logical step for location based social networks. It’s just no fun to use one service but give up the ability to see where your friends on other networks are. Siloed social networks end up competing not on the quality of their services, but on the number of your friends they have locked-in to their network in particular. Setting users free through a universal, interoperable check-in would be a bold move. It will be interesting to see how Brightkite tries to do it and how its competitors respond. (We’ve got inquiries in asking a few of them.)
Walled gardens are already under attack because of the ease of sending content like messages and photos from one website to another. Sites that don’t let content flow in and out freely, when that’s what users want, are fighting against the powerful tide of the internet.
Earlier this month social software designer Adrian Chan
The Activity Streams discussion is participated in by 
Developers were recently given permission to ask app users for their email addresses, which they can use to email app notifications directly. (Granted, that could get annoying too, but at least it’s opt-in.) The creation of a special
Mark Fletcher, the man who built one of the first easy email group services online and sold it to Yahoo! for $400 million, then built former market-leading RSS reader 
Fletcher said he used outsourced development and design services extensively in creating SnapGroups. He built the site for a mere $6k, a tiny fraction of what it took to build his previous products. There will be Twitter integration at launch and Facebook integration later. “We will tap into power-user groups at first,” Fletcher explained, “and have larger moderator groups to help shape the service going forward.”
Swedish marketing technologist Dennis Hettema has created a hot-item tracking website for the most-shared items on Google Buzz, called 
Facebook has been granted a patent on the Newsfeed, “displaying a news feed in a social network environment.”
18 months ago
“The writing is on the wall that there will be baseline privacy legislation introduced,” said John Morris, general counsel for the
Apps on the iPhone, there are so very many of them – how’s a person to find the best ones? We look at a whole lot of them here at ReadWriteWeb and we’d like to share with you some of our favorites we’ve discovered in the month of February.

Millions of people click, click, click their way mindlessly through repetitive casual games like
True to the backgrounds of the company’s founders, Gowalla is very focused on design. Its badges, like stamps on a passport displaying where a user has checked in, are beautiful. Its user experience is simple but clear and enjoyable. Foursquare may be much bigger and have more commercial partnerships but Gowalla is much prettier and does certain things better, like importing friends from other social networks.
Williams says that when Facebook launches location, he hopes that many people will want to use Gowalla as the interface to post to Facebook. They needn’t wait, Facebook Connect integration is live today, but full-on entry into the location market by Facebook is going to be a very big deal.
Morgan’s company pocketed a part of Gowalla’s war chest today when the social network announced that it was deploying Skyhook Wireless’s location software in the Android version of Gowalla. Skyhook has driven around the country and cataloged the location of more than 80 million WiFi hotspots. It then tells its customers where they are with precision, based on the MAC addresses of nearby WiFi signals. Gowalla queries Skyhook for a device’s location, to supplement the GPS data, Skyhook sends that data back and then Gowalla interprets it to suggest businesses and other venues that a user is probably at. Skyhook is now baked into the iPhone OS, but Morgan is still selling the service to other platforms and application developers.
Finding the right people to follow on Twitter can offer a real competitive advantage in many lines of work. Some people are very good at it; they are super connected and they find great people to follow. Now a new service built on top of Twitter lets you ride the coattails of those well-connected people and easily follow whoever they add as friends, too.
I don’t want to creep anyone out, but if you’re someone I think is really interesting and has an interesting taste in friends – I may be getting an IM now with the Twitter username of everyone you start to follow. For the past week I’ve been tracking a number of interesting people with RSSFriends feeds run through the RSS-to-IM service 



Twitter founder Evan Williams posted a message yesterday that was easy to misunderstand: “Met the Dalai Lama today in LA. Pitched him on using Twitter. He laughed.” 


The Internet of Things, the growth and bringing online of sensor data to create a foundation for innovation, is expected to be a big trend in 2010. ReadWriteWeb has been covering it extensively and we offer below the three top stories in Internet of Things over the last 24 hours, from around the web.