...
In addition to an increase in capacity, we have made the following changes:*
- The cluster network interconnect has changed from InfiniBand to 10 Gigabit Ethernet to allow our high-bandwidth communication needs to grow in conjunction with our Data Center.
...
- Several computing nodes will have 96GB of RAM per node (or 8GB per core) for memory-intensive jobs.
...
- An experimental GPU research environment that can deliver up to 1 Teraflops of computing power in double-precision floating point mode has been added for exploration of alternate parallel computing methods.
The upgrade has been both extensive and complex. Following the acquisition, which started in November 2010 and was completed in May 2011, three additional phases during the month of August were needed to transition from the old to the new HPC environment:
...