System Configuration

 

SYSTEM CONFIGURATION

PARAM Yukti provides a total of 1.8 PETAFLOPS of combined CPU and GPU compute power. PARAM Yukti comprises a total of 166 nodes   ( 156 + 10)  which are distributed as follows:

  •     Login nodes: 4
  •     Service / Master nodes: 6
  •     CPU only nodes: 75
  •     GPU nodes: 42
  •     High Memory nodes: 39

CONFIGURATION OF COMPUTE (CPU) NODES:

  •     CPU: 2 x Intel Xeon, 8268 24 Cores @ 2.9GHz
  •     RAM: 192 GB
  •     Storage: 480 GB SSD

The High Memory nodes have the same base configuration as the compute nodes but with an increased RAM capacity of 768 GB.

CONFIGURATION OF GPU ENABLED NODES:

      With 2 GPU cards: 10 Nodes

  •     CPU: 2 x Intel Xeon, 6248 20 Cores @ 2.5GHz
  •     GPU: 2 x NVIDIA V100 SXM2 cards
  •     RAM: 192 GB
  •     HDD: 480 GB SSD

     With 4 GPU cards: 32 Nodes

  •     CPU: 2 x Intel Xeon, 8268 24 Cores @ 2.9GHz
  •     GPU: 4 x NVIDIA V100 SXM2 cards
  •     RAM: 192 GB
  •     HDD: 480 GB SSD

 

INTERCONNECT

  • PRIMARY NETWORK:  100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology.
  • SECONDARY NETWORK :  10G/1G Ethernet Networking Management network: 1G Ethernet.

STORAGE

  • A separate storage server provides a total of 1PB of storage space for user data.

The entire system operates on LINUX - CentOS 7.6, and uses SLURM job scheduler and the Lustre Parallel File System.