Overview of Supercomputer system
System configuration
Supercomputer system “Grand Chariot 2” consists of CPU nodes, GPU nodes, and the Supercomputer storage system.
System specifications
CPU nodes
| System | Machine name | PRIMERGY CX2550 M7, PRIMERGY CX400 M7 |
| Number of nodes | 480 | |
| Peak FLOPS (Double precision) |
2.45PFLOPS | |
| Total memory amount | 245TB | |
| Network topology | Full-bisection Fat Tree | |
| Node | Number of CPUs (Number of cores) |
2 (2×32=64) |
| Peak FLOPS (Double precision) |
5.12TFLOPS (2.5GHz×32-core×32-operation×2CPU) |
|
| Total memory amount | 512GiB | |
| Peak memory bandwidth | 665.6GB/s (5,200MHz×8B×8ch×2CPU) |
|
| Interconnect | InfiniBand NDR × 1 (400Gbps × 1) |
|
| OS | Rocky Linux | |
| CPU | CPU name | Intel Xeon Gold 6548Y+ |
| Architecture | Emerald Rapids | |
| Clock | 2.5GHz (Up to 4.1GHz by Turbo boost ) |
|
| Number of cores | 32 | |
| Peak FLOPS (Double precision) |
2.56TFLOPS |
GPU nodes
| System | Machine name | PRIMERGY GX2560 M7 |
| Number of nodes | 24 | |
| Peak FLOPS (Double precision) |
6.55PFLOPS | |
| Total memory amount | 12.288TB | |
| Network topology | Full-bisection Fat Tree | |
| Node | Number of CPUs (Number of cores) |
2 (2×32=64) |
| Peak FLOPS of CPUs (Double precision) |
5.12TFLOPS (2.5GHz×32-core×32-operation×2CPU) |
|
| Total memory amount | 512GiB | |
| Peak memory bandwidth | 665.6GB/s (5,200MHz×8B×8ch×2CPU） |
|
| Number of GPUs | 4 | |
| Peak FLOPS of GPUs | 267.6TFLOPS (66.9TFLOPS×4GPU） |
|
| Interconnect | InfiniBand NDR × 2 (400Gbps × 2) |
|
| OS | Rocky Linux | |
| CPU | CPU name | Intel Xeon Gold 6548Y+ |
| Architecture | Emerald Rapids | |
| Clock | 2.5GHz (Up to 4.1GHz by Turbo boost) |
|
| Number of cores | 32 | |
| Peak FLOPS (Double precision) |
2.56TFLOPS | |
| GPU | GPU name | NVIDIA H100 |
| Architecture | Hopper | |
| Peak FLOPS (FP64) | 66.9TFLOPS | |
| GPU memory amount | 80GB (HBM3) | |
| GPU memory bandwidth | 3.352TB/s |
Supercomputer storage system
| Machine name | DDN ES400NVX2 |
| File system | DDN EXAScaler (Lustre) |
| Total capacity | 16.95PB |
| Drive configuration | Full SSD (All Flash) |
| Data transfer speed | 390GB/s |