PNY NVIDIA H100 NVL PCIE 94 GB HBM3
|
|
PNY NVIDIA H100 NVL PCIE 94 GB HBM3
-
GPU Family
NVIDIA
-
GPU
H100
-
Interface
PCI Express 5.0
-
Video Memory
94GB
-
Video Memory Type
HBM3
-
Memory Bus
6016 bit
-
HDMI
0
-
Displayport
0
-
USB-C
0
-
Profile
Dual Slot
-
Cooling Type
Passive
|
NVIDIA® H100 NVL
NVIDIA® H100 NVL supercharges large language model inference in mainstream PCIe-based server systems. With increased raw performance, bigger, faster HBM3 memory, and NVIDIA NVLink™ connectivity via bridges, mainstream systems with H100 NVL outperform NVIDIA A100 Tensor Core systems by up to 5X on Llama 2 70B.
Specifications:
FP64
FP64 Tensor Core
FP32
TF32 Tensor Core
BFLOAT16 Tensor Core
FP16 Tensor Core
FP8 Tensor Core
INT8 Tensor Core
GPU Memory
GPU Memory Bandwidth
Maximum Thermal Design Power (TDP)
NVIDIA AI Enterprise
Please note that although care has been taken in the degree of relevancy, pictures are for
display purposes only, and product appearance may differ from what you see. If there are any
discrepancies between the product headline, description and picture, the correct information
will be in the product headline (i.e. computer systems may not come with monitors even if
pictured that way). If anything is unclear, please email support before placing your order.