FP32 31.2 TFLOPS
TF32 Tensor Core 62.5 TFLOPS | 125 TFLOPS*
BFLOAT16 Tensor Core 126 TFLOPS | 250 TFLOPS*
FP16 Tensor Core 165 TFLOPS | 330 TF*
INT8 Tensor Core 250 TOPS | 500 TOPS*
INT4 Tensor Core 500 TOPS | 1000 TOPS*
RT Cores 72
Encode/Decode 1 Encoder
1 Decoder
(+AV1 Decode)
GPU Memory 24 GB GDDR6
Memory Bandwidth 600 GB/s
System Interface PCIe Gen 4.0 | 64 GB/s
Thermal Solution Passive
Form Factor 1 Slot Full Height, Full Length (FHFL)
Maximum Power Consumption 150 W
Auxiliary Power Connector PCIe 8-pin
vGPU Support NVIDIA vPC
NVIDIA vApps
NVIDIA RTX vWS
NVIDIA Virtual Compute Server (vCS)