Firstpost
  • Home
  • Video Shows
    Vantage Firstpost America Firstpost Africa First Sports
  • World
    US News
  • Explainers
  • News
    India Opinion Cricket Tech Entertainment Sports Health Photostories
  • Asia Cup 2025
Apple Incorporated Modi ji Justin Trudeau Trending

Sections

  • Home
  • Live TV
  • Videos
  • Shows
  • World
  • India
  • Explainers
  • Opinion
  • Sports
  • Cricket
  • Health
  • Tech/Auto
  • Entertainment
  • Web Stories
  • Business
  • Impact Shorts

Shows

  • Vantage
  • Firstpost America
  • Firstpost Africa
  • First Sports
  • Fast and Factual
  • Between The Lines
  • Flashback
  • Live TV

Events

  • Raisina Dialogue
  • Independence Day
  • Champions Trophy
  • Delhi Elections 2025
  • Budget 2025
  • US Elections 2024
  • Firstpost Defence Summit
Trending:
  • PM Modi in Manipur
  • Charlie Kirk killer
  • Sushila Karki
  • IND vs PAK
  • India-US ties
  • New human organ
  • Downton Abbey: The Grand Finale Movie Review
fp-logo
Twitter updates search index, will now let you search tweets going all the way back to 2006
Whatsapp Facebook Twitter
Whatsapp Facebook Twitter
Apple Incorporated Modi ji Justin Trudeau Trending

Sections

  • Home
  • Live TV
  • Videos
  • Shows
  • World
  • India
  • Explainers
  • Opinion
  • Sports
  • Cricket
  • Health
  • Tech/Auto
  • Entertainment
  • Web Stories
  • Business
  • Impact Shorts

Shows

  • Vantage
  • Firstpost America
  • Firstpost Africa
  • First Sports
  • Fast and Factual
  • Between The Lines
  • Flashback
  • Live TV

Events

  • Raisina Dialogue
  • Independence Day
  • Champions Trophy
  • Delhi Elections 2025
  • Budget 2025
  • US Elections 2024
  • Firstpost Defence Summit
  • Home
  • Tech
  • News & Analysis
  • Twitter updates search index, will now let you search tweets going all the way back to 2006

Twitter updates search index, will now let you search tweets going all the way back to 2006

Nimish Sawant • November 19, 2014, 13:23:54 IST
Whatsapp Facebook Twitter

You can now search public tweets dating back to the first tweet sent out, back in 2006

Advertisement
Subscribe Join Us
Add as a preferred source on Google
Prefer
Firstpost
On
Google
Twitter updates search index, will now let you search tweets going all the way back to 2006

Twitter made a big announcement on its blog last night. You can now search public tweets dating back to the  first tweet sent out, back in 2006. While Twitter always stored the tweets permanently, it used to purge them from the search index from time to time, in order to keep the recency of tweets intact. But with the new announcement, the search net you lay out on Twitter will gather a lot more tweets. According to the blog, that has been Twitter’s long standing goal. According to the blog, Twitter already had a real-time index which stored the most recent tweets of the past couple of weeks. This was done in order to keep the results recent. The full index on the other hand is around 100 times larger than the real-time index and required additional capacity, re-partitioning and operational overheads. While the real-time index was stored on RAM memory to keep the updates fast and latency at the minimum, using RAM is not possible for the full index as that increases the costs. Also the search index has been a work in progress. The blog mentions a 2012 historical index which had 2 billion top tweets of the time. In order to search for tweets which were not showing in Twitter search results, one had to make use of third-party tools such as Topsy and TwimeMachine. It may seem like a fully-indexed search engine should have been a Twitter feature since ages, but Twitter did not have its own search engine even for recent tweets till 2011 which is five years after it was founded. Making the fully indexed search engine came with its set of challenges. Apart from indexing the older tweets, Twitter also had to find a way to index the upcoming tweets. Twitter employs hundreds of machines running Hadoop MapReduce, which is a popular open-source data-crunching tool, to collect and arrange the data for its entire search index. This makes the process parallelised, in the sense that one group of machines can work on indexing older tweets, whereas another machine can work on indexing the new tweets using the same set of software. Twitter uses solid-state drives to store the the indexed data instead of using RAM memory, used for real-time index. You can get a more detailed lesson on how Twitter goes about implementing the new search feature in this blog by Yi Zhuang. You can check out Twitter’s Advanced search page which lets you refine your search, based on words, people, places and dates. This is much better than doing a search on Twitter’s official site which does not have the granularity present on the advanced search. It also lets one be focussed when searching major events or hashtags. While this makes research easier, you are also reminded of the embarassing tweets or twitter conversations you may have had in the past. Twitter will start rolling out the feature gradually on its Android and iOS apps. You will now be able to see search results going all the way back to 2006 when you select the All tab under search results.

Tags
Twitter Search real time index Twitter advanced search Twitter search index
End of Article
Latest News
Find us on YouTube
Subscribe
End of Article

Top Stories

Russian drones over Poland: Trump’s tepid reaction a wake-up call for Nato?

Russian drones over Poland: Trump’s tepid reaction a wake-up call for Nato?

As Russia pushes east, Ukraine faces mounting pressure to defend its heartland

As Russia pushes east, Ukraine faces mounting pressure to defend its heartland

Why Mossad was not on board with Israel’s strike on Hamas in Qatar

Why Mossad was not on board with Israel’s strike on Hamas in Qatar

Turkey: Erdogan's police arrest opposition mayor Hasan Mutlu, dozens officials in corruption probe

Turkey: Erdogan's police arrest opposition mayor Hasan Mutlu, dozens officials in corruption probe

Russian drones over Poland: Trump’s tepid reaction a wake-up call for Nato?

Russian drones over Poland: Trump’s tepid reaction a wake-up call for Nato?

As Russia pushes east, Ukraine faces mounting pressure to defend its heartland

As Russia pushes east, Ukraine faces mounting pressure to defend its heartland

Why Mossad was not on board with Israel’s strike on Hamas in Qatar

Why Mossad was not on board with Israel’s strike on Hamas in Qatar

Turkey: Erdogan's police arrest opposition mayor Hasan Mutlu, dozens officials in corruption probe

Turkey: Erdogan's police arrest opposition mayor Hasan Mutlu, dozens officials in corruption probe

Top Shows

Vantage Firstpost America Firstpost Africa First Sports
Latest News About Firstpost
Most Searched Categories
  • Web Stories
  • World
  • India
  • Explainers
  • Opinion
  • Sports
  • Cricket
  • Tech/Auto
  • Entertainment
  • IPL 2025
NETWORK18 SITES
  • News18
  • Money Control
  • CNBC TV18
  • Forbes India
  • Advertise with us
  • Sitemap
Firstpost Logo

is on YouTube

Subscribe Now

Copyright @ 2024. Firstpost - All Rights Reserved

About Us Contact Us Privacy Policy Cookie Policy Terms Of Use
Home Video Shorts Live TV