The availability of IT staff to manage big data will fail to keep pace with information growth rates over the next decade, according to analyst figures.
The report by analyst firm, IDC, titled Extracting Value from Chaos, predicts 1.8 zettabytes of digital information will be created and replicated in 2011, equivalent to every person in the UK tweeting three tweets per minute for 1.7 years.
"IT skills, experience and resources to manage the increase of data is failing to keep pace with growth levels," said IDC in the report.
The EMC-sponsored report predicts IT departments will have to manage 50 times the amount of information, 75 times the number of files and 10 times the number of virtual and physical servers, with only 1.5 times the number of IT professionals to manage it all, by 2020.
"The number of files, or containers that encapsulates the information in the digital universe, is growing even faster than the information itself. In the next five years, these files will grow by a factor of eight, while the pool of IT staff available to manage them will grow only slightly," the report said.
According to the study, 75% of digital information is generated by individuals but enterprises are liable for 80% of this information at some point in its digital life.
This is a concern for businesses when less than a third of information has minimal security protection and only a half of sensitive information is protected, said the report.
IDC figures also show enterprise investment into cloud, hardware, software, services and staff to manage the increase in data has increased 50% since 2005 to reach $4 trillion.