Microsoft, Intel and Dell Computer will provide the CTC, located on the Ithaca, New York, campus of Cornell University, with $60m (£39m) in technology resources over the next four years. This will help CTC double the size of an existing 425 server cluster used for high performance computing (HPC) tasks.
The cost of building and maintaining the CTC cluster has already shown substantial cost savings over specialised computers designed for similar tasks, Thomas Coleman, CTC director and Cornell computer scientist, said.
"Clustered computing has a big edge over traditional supercomputing in cost per cycle," Coleman said.
Unlike some supercomputers that use custom-made interconnect and processing technology, the CTC cluster is built out of readily available technology. It links together hundreds of Dell PowerEdge servers running on Intel's Xeon and Itanium chips and Microsoft's server software to create a powerful computer that can handle large, complex calculations.
The effort to expand the CTC cluster marks a growing trend in the industry to use commodity products for complex computing tasks. Ever-improving processor performance and better software tools have made it possible to build powerful computers out of off-the-shelf components. While these systems can handle many tasks, traditional supercomputers are still considered the best option for the most complex computing work done by laboratories and other research bodies. Microsoft, Intel and various server makers, however, have been honing their technology for years to try to build ever-larger clusters and make inroads into the supercomputer market.
The CTC cluster will be used for research into a variety of areas, including bioinformatics, behavioural and social sciences, computer science, engineering, and business. The group involved hopes to advance high performance computing in these areas by creating technology that can be used by the private sector.
CTC plans to create a technology showcase centre for its applications in the financial district of New York. This centre will help link the lab's projects with clients, Coleman said.