It seems that when we look for matches we collect significant quantities of data that we mostly throw away as the search is narrowed down.
One place where this is really important is in intelligence data mining, supporting front line investigations. US researchers have hit upon a method called Outliers that can drastically reduce the time of searching and increase accuracy.
While running a couple of workshops at a law enforcement conference in Colorado, I picked up some of this background. It could mean that for the first time a police officer in the front line can have access to useful and fast intelligence sources.
So when stopping a red Ford Escort with a blue wing, the officer can access any known information before even approaching the car.
Apparently Stephen Hawking first mooted the idea when searching interstellar data. (If you search for Outliers on the Internet you'll find plenty of background material.)
What particularly interested me were the results that had been produced using this form of data analysis, where information on suspects and had been mapped over time for a number of solved cases.
The researchers found that cases could be solved three times quicker and with greater accuracy, which they judge as four times as good, so that the whole process is very much faster.
If I can see the commercial possibilities of this it probably means that someone out there is working on it.
Should we worry?
What's your view?
Are there other techniques that our boys in blue could use? Let us know with an e-mail >>
CW360.com reserves the right to edit and publish answers on the Web site. Please state if your answer is not for publication.
Martyn Hart is chairman of the National Outsourcing Association and practice director at Mantix, a consultancy that delivers value from complex programmes.