KDnuggets : News : 2005 : n24 : item28 < PREVIOUS | NEXT >

Briefs

Alexa Web Search Platform

December 12, 2005. Announcing the Alexa Web Search Platform Beta

Alexa is releasing the Alexa Web Search Platform Beta (websearch.alexa.com), effectively opening up the Alexa Web Crawl and ushering in a new era where anybody can create new search services without having to invest millions of dollars in crawl, storage, processing, search and server technology.

Since 1996, Alexa has been crawling and storing the Web at millions of pages per day. Alexa has also been building out the infrastructure to store and analyze the data and serve it to toolbars, browsers, and websites worldwide. Now, all of that infrastructure is yours to use via the Alexa Web Search Platform:

  • Three online web snapshots of up to 100 terabytes each
  • Powerful tools to sift through the content to create your own data set
  • Upload, compile and run your own programs on a processing cluster across the data set
  • Store your output on a storage cluster
  • Integrate your data into a search index
  • Access your new search via Amazon Web Services
According to Wired News, Alexa spiders 4 billion to 5 billion pages a month and archives 1 terabyte of data a day. The new platform will allow developers to build their own search engines.

See websearch.alexa.com.


KDnuggets : News : 2005 : n24 : item28 < PREVIOUS | NEXT >

Copyright © 2005 KDnuggets.   Subscribe to KDnuggets News!