Twitter has quietly been working on a way to index every single tweet sent within its walls (at least since 2006) to be searchable for anyone that may desire to find something specifically. Well, now they’ve pretty much done that. Over the course of a few years, the company has managed to keep storing the billions of new tweets sent each week, and accommodate the existing ones under its own search engine.
“We built a search service that efficiently indexes roughly half a trillion documents and serves queries with an average latency of under 100ms,” Twitter’s Yi Zhuang explained in a blog post today.
As you can probably imagine, this will be a hidden treasure for any company or brand that wants to know what was being said at a certain time. This new massive Twitter index will be rolling out to users over the next week or so, and will be available through the Web, and Twitter’s mobile apps.