With 600 million unique visits per month, Yahoo sees a large amount of traffic to its sites. In order to maintain sites in the cloud, Yahoo uses Traffic Server, a piece of software initially acquired via Inktomi, to support this massive amount of traffic.
Tomorrow, Yahoo will be debuting an open source version of Traffic Server. The code is available through the Incubator project at the Apache Software Foundation.
Traffic Server enables the session management, authentication, configuration management, load balancing, and routing for an entire cloud computing stack. Yahoo says that with the open source version of Traffic Server, organizations can benefit from access to cached online content. In addition, Traffic Server enables faster responses to requests for stored Web objects, such as files, news articles or images.
The company’s global network of data centers allows Traffic Server to choose the closest servers to store and access cached content for increased speed. Traffic Server is capable of handling more than 30,000 requests per second per server and it currently serves more than 400 terabytes of data per day.
Yahoo is also announcing an update to the Yahoo Distribution of Hadoop which is now deployed extensively in Yahoo data centers worldwide. These include new features and bug fixes that continue to improve robustness, security, performance, and operability of Hadoop for ongoing large scale deployments.
Yahoo says that opening of code for Traffic Server and the distribution of Hadoop reinforces the technology company’s commitment to open source technologies. Yahoo has been the primary developer and investor to Apache’s Hadoop. In 2006, Hadoop founder Doug Cutting joined Yahoo to lead the project of developing the open-source software. Hadoop now provides the framework for many Yahoo properties including Yahoo Search, Yahoo Mail, and several content and ad services.