Carya Cluster
Carya is the largest HPE-DSI shared campus resource, providing shared access to public CPU and GPU compute nodes and centralized storage resources. It hosts a total of 17 K Intel Xeon Gold CPU cores and 1,054 K Nvidia GPU cores integrated within 305 compute and 40 GPU nodes. All nodes are equipped with solid state drives (SSD) for local high-performance data storage. This will offer the fastest disk based I/O on Carya.
Carya is operated under HPE-DSI. It is housed in the RCDC (Research Computing Data Core) and went into production in early September 2020. If you plan to use this system, please make sure your PI has been granted an allocation and you have requested an account on the system. Please refer to the User Guide to find out about specifics of running jobs, selecting resources, and available software on this cluster.
Theoretical FP64 peak performance is approximately 1.7 PFlops.
| Node Type | CPU Type | CPU Socket Count | Total Cores | Memory | SSD Disk Space | Node Count |
|---|---|---|---|---|---|---|
| Login HPE ProLiant DL380 | Intel Xeon Gold 6252 | 2 |
48 |
192 GB | 8 TB | 1 |
| Compute ProLiant HPE XL170r | Intel Xeon Gold 6252 | 2 | 48 | 192 GB | 960 GB | 246 |
| Compute ProLiant HPE XL220n | Intel Xeon Gold 5320 |
2 |
52 | 256 GB | 960 GB | 51 |
| GPU Accelerator HPE ProLiant XL190r | Intel Xeon Gold 6252 Nvidia V100 |
CPU: 2 |
CPU: 48 GPU: 10,240 |
CPU: 192 GB GPU: 64 GB |
960 GB | 16 |
| GPU Accelerator HPE ProLiant XL270d | Intel Xeon Gold 6252 Nvidia V100 |
CPU:2 |
CPU: 48 GPU: 40,960 |
CPU: 377 GB GPU:256 GB |
1.92 TB | 4 |
| GPU Accelerator HPE ProLiant DL380 | Intel Xeon Gold 6430 Nvidia L40S |
CPU: 2 GPU: 2 |
CPU: 64 GPU: 18,176 |
CPU: 512 GB GPU: 96 GB |
960 GB | 20 |
| Large Memory HPE ProLiant DL380 | Intel Xeon Gold 6252 | 2 | 48 | 770 GB | 1.92 TB | 8 |
Interconnect: Carya nodes are connected via Mellanox Infiniband HDR100 switches with a 100Gb/s
Line Rate.
Storage: Carya has 1.5 PB of shared hard-disk-based storage and 122 TB of shared flash storage
space.