Intel Xeon Silver 4216 (16 core, 32 threads, upto 3.2 Hz) 
2 X 64GB(128GB) DDR4 ECC 3200MHZ 
NVIDIA RTX 2000 Ada 16GB
MiPhi 1 x 1.92 TB AI Boot Drive
Intel Xeon Gold 6338 Processor (32 core, 64 threads, upto 3.2GHz) 4 X 64GB (256GB) DDR4 ECC 3200MHZ Dual NVIDIA RTX 2000 Ada 16GBMiPhi 1 x 1.92 TB AI Boot Drive
Intel Xeon Gold 6338 Processor (32 core, 64 threads, upto 3.2GHz) 8 X 64GB (512GB) DDR4 ECC 3200MHZ Dual Nvidia RTX 4000ADA Quadro 20GBMiPhi 1 x 1.92 TB AI Boot Drive
|
|||||||||
| Supports up to 13B parameter models | |||||||||
| 3 B | 128GB | 1 | 1 | 2 | |||||
| 7 B | 128GB | 1 | 1 | 2 | |||||
| 13 B | 128GB | 1 | 1 | 2 | |||||
| Supports up to 34B parameter models | |||||||||
| 34 B | 256GB | 2 | 1 | 2 | |||||
| Supports up to 70B parameter models | |||||||||
| 70 B | 512GB | 2 | 1 | 4 | |||||
