High Performance Computing Systems
Thunder
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 228 TBytes | Lustre |
/workspace ($WORKDIR) | 17.3 PBytes | Lustre |
Login Nodes | Compute Nodes | ||||
---|---|---|---|---|---|
Standard Memory | Large Memory | Accelerator Nodes | |||
GPU | Phi | ||||
Total Nodes | 16 | 3,216 | 4 | 178 | |
Operating System | SLES 11 | ||||
Cores/Node | 28 | 36 | 28 + 2 GPU (2 x 2,880 GPU cores) |
28 + 2 Phi (2 x 61 Phi cores) |
|
Core Type | Intel E5-2699v3 | Intel E5-2697v3 +NVIDIA Tesla K40M |
Intel E5-2697v3 +Intel 7120P |
||
Core Speed | 2.3 GHz | 2.6 GHz | |||
Memory/Node | 128 GBytes | 768 GBytes | 128 GBytes +24 GBytes |
128 GBytes +16 GBytes |
|
Accessible Memory/Node | 126 GBytes | 766 GBytes | 126 GBytes | 126 GBytes +15.5 GBytes |
|
Memory Model | Shared on node. | Shared on node. Distributed across cluster. |
|||
Interconnect Type | FDR 14x InfiniBand | FDR 14x InfiniBand; Enhanced LX Hypercube |
Lightning
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 678 TBytes | Lustre |
/p/work1 /p/work2 ($WORKDIR) | 1.3 PBytes | Lustre |
Login Nodes | Compute Nodes | ||
---|---|---|---|
Standard Memory | Accelerator Nodes | ||
GPU | |||
Total Nodes | 12 | 2,370 | 32 |
Operating System | SLES 11 | Cray Linux Environment | |
Cores/Node | 24 | 10 + 1 GPU (1 x 2,880 GPU cores) |
|
Core Type | Intel Xeon E5-2697v2 | Intel Xeon E5-2670v2 +NVIDIA Tesla K40 |
|
Core Speed | 2.7 GHz | 2.5 GHz | |
Memory/Node | 256 GBytes | 64 GBytes | 32 GBytes +12 GBytes |
Accessible Memory/Node | 240 GBytes | 63 GBytes | 30 GBytes |
Memory Model | Shared on node. | Shared on node. Distributed across cluster. |
|
Interconnect Type | Ethernet | Cray Aries |
Spirit
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 1.2 PBytes | Lustre |
/workspace ($WORKDIR) | 1.2 PBytes | Lustre |
Login Nodes | Compute Nodes | |
---|---|---|
Total Nodes | 8 | 4,590 |
Operating System | RHEL 6 | |
Cores/Node | 16 | |
Core Type | Intel E5 Sandy Bridge | |
Core Speed | 2.6 GHz | |
Memory/Node | 64 GBytes | 32 GBytes |
Accessible Memory/Node | 62 GBytes | 29 GBytes |
Memory Model | Shared on node. | Shared on node. Distributed across cluster. |
Interconnect Type | FDR 14x InfiniBand | FDR 14x InfiniBand; Enhanced LX Hypercube |
Utility Server
Path | Capacity | Type |
---|---|---|
/us/work/ | 200 TBytes | PanFS |
/u/home | 20 TBytes | PanFS |
/p/cwfs | 800 TBytes | PanFS |
Login Nodes | Compute Nodes | |
---|---|---|
Total Nodes | 2 | 44 |
Operating System | RHEL | |
Cores/Node | 16 | |
Core Type | AMD Opteron 6134 Magny-Cours (x2) | |
Core Speed | 2.3 GHz | |
GPU Type | N/A | |
Memory/Node | 64 GBytes | 128 GBytes |
Accessible Memory/Node | 62 GBytes | 126 GBytes |
Memory Model | Shared on node | Shared on node. Distributed across cluster. |
Interconnect Type | QDR InfiniBand | |
Graphics Nodes | Large Memory Nodes | |
Total Nodes | 22 | 22 |
Operating System | RHEL | RHEL |
Cores/Node | 16 | 32 |
Core Type | AMD Opteron 6134 Magny-Cours (x2) | AMD Opteron 6134 Magny-Cours (x4) |
Core Speed | 2.3 GHz | 2.3 GHz |
GPU Type | NVIDIA Tesla M2050 | N/A |
Memory/Node | 128 GBytes | 256 GBytes |
Accessible Memory/Node | 126 GBytes | 250 GBytes |
Memory Model | Shared on node. Distributed across cluster. |
Shared on node. Distributed across cluster. |
Interconnect Type | QDR InfiniBand | QDR InfiniBand |
Predator
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 88 TBytes (shared across both partitions) | XFS |
/workspace ($WORKDIR) | XFS |
Login Nodes | Compute Nodes | |
---|---|---|
Total Nodes | 1 | 1 |
Operating System | RHEL 6 | RHEL 6 |
Cores/Node | 8 | 1004 |
Core Type | Intel E5 Sandy Bridge | Intel E5 Sandy Bridge |
Core Speed | 2.7 GHz | 2.7 GHz |
Memory/Core | 4 GBytes | 4 GBytes |
Accessible Memory/Core | 3.5 GBytes | 3.5 GBytes |
Memory Model | Shared | Shared |
Interconnect Type | Numalink v6 | Numalink v6 |
Talon
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 29 TBytes (shared across both partitions) | Panasas |
/workspace ($WORKDIR) | Panasas |
Login Nodes | Compute Nodes | |
---|---|---|
Total Nodes | 6 | 12 |
Operating System | CENTOS 5 | CENTOS 5 |
Cores/Node | 8 | 8 |
Core Type | Intel Nehalem-EP | Intel Nehalem-EP |
Core Speed | 2.8 GHz | 2.8 GHz |
Memory/Node | 48 GBytes* | 24 GBytes |
Accessible Memory/Node | 48 GBytes* | 24 GBytes |
Memory Model | Distributed | Distributed |
Interconnect Type | DDR IB | DDR IB |
*talon1 and talon6 have only 24 GBytes of memory. |
Lancer
Path | Capacity | Type |
---|---|---|
/home ($HOME) | 1.2 PBytes | Lustre |
/workspace ($WORKDIR) | 1.2 PBytes | Lustre |
Login Nodes | Compute Nodes | |
---|---|---|
Total Nodes | 2 | 160 |
Operating System | RHEL 6 | RHEL 6 |
Virtualization/Hypervisor | n/a | ScaleMP vSMP Foundation |
Cores/Node | 16 | 16 |
Core Type | Intel Xeon E5-2670 Sandy Bridge |
Intel Xeon E5-2670 Sandy Bridge |
Core Speed | 2.6 GHz | 2.6 GHz |
Memory/Node | 64 GBytes | 128 GBytes |
Accessible Memory/Node | 62 GBytes | 30 GBytes |
Memory Model | Shared on node. | Shared on node. Distributed across cluster. |
Virtual Machine 1, 3, & 4 | Virtual Machine 2 | |
Compute Nodes | Compute Nodes | |
Total Nodes | 32 | 64 |
Total Cores | 512 | 1024 |
Total Memory | 4 TBytes | 8 TBytes |
Total Accessible Memory | 3.3 TBytes | 6.5 TBytes |
Accessible Memory/Node | 6.6 GBytes | 6.6 GBytes |