Google has introduced a new indexing system that will halve the time it takes to find new information on the web in whatever format it exists.
Writing on Google's blog, software engineer Carrie Grimes said Caffeine analysed the web in small portions and updated the Google search index on a continuous basis, globally. "As we find new pages, or new information on existing pages, we can add these straight to the index," she said.
Caffeine processes hundreds of thousands of pages in parallel every second. It takes up nearly 100 million gigabytes of storage in one database and adds hundreds of thousands of gigabytes per day.
Google was doing this to meet higher expectations of users and publishers who expected to see their stories listed as soon as they were published, she said.