Data warehousing and business intelligence supplier Teradata has unveiled a slew of products in anticipation of a huge increase in the amount of data that companies will collect, store and analyse.
The data will come from new sources such as social networks, geolocations and sensors in what Teradata chief operating officer Darryl McDonald described as "the socialisation of data".
Anyone not intending to collect and analyse what customers and competitors are saying about them on social networking sites such as Facebook, Linked-In and Twitter might as well pack up their data and call centres and go home, he said.
"The key issue is to use the insights from this data to differentiate yourself in a way that puts you so far ahead that no-one can catch you," he told 3,000 delegates at Partners, the annual Teradata customer conference, held this year in San Diego.
Teradata unveiled four new hardware database engines that drive Terdadata's latest high-performance database, Teradata 13.10. The all-silicon data warehouses are powered by dual Intel Xeon processors, code named Westmere, the latest processor product from Intel, with six computing cores.
Each server also has Teradata's optimised parallel design, which uses Intel hyper-threading technology to enable 24 virtual cores per compute server. This allows users to match core processing to physical drives for higher performance.
The new systems allow customers to address databases ranging in size from up to 11.7 terabytes to 86 petabytes.
Teradata also released details of a new data storage facility, Extreme Performance appliance. The solid state disc offers performance up to 18 times faster that conventional rotating memory.
Teradata also delivered a Teradata plug-in for Eclipse to integrate with existing application development environments that enable Teradata in-database services. "Karmasphere software is the first developer platform that harnesses the power of Hadoop and Teradata," said McDonald.
Programmers could write MapReduce applications in a simple drag-and-drop interface that uses data and processing capabilities from both Teradata systems and Hadoop simultaneously.
"These environments enable accelerated development of analytic services that can be leveraged by applications across the enterprise. A Microsoft Visual Studio plug-in is also available for .Net development.
Teradata also said it would deal better with data histories. It became the first to deliver intelligent time-aware analytics, making it easy for users to build up a picture of their business over time. For example, an insurance company can now easily manage risk exposure associated with current and past states of customer policies when deciding to grant future policies.
Teradata was using "data labs" that refer to work spaces within the data warehouse where users can explore and analyse new data and test theories "in the cloud". Analysts can add new data, then combine it with existing data inside the data warehouse without worrying about impacting production users.
In addition, SAS and Teradata have released an appliance version of data labs to perform accelerated in-depth analysis.