Datasets

Data-centre GPU specifications

Name: Data-centre GPU specifications
Published: 2026-11-06
License: https://creativecommons.org/licenses/by/4.0/

Memory, memory bandwidth, dense FP8/BF16/FP32 throughput, interconnect and power for NVIDIA H100, H200 and L40S variants, from vendor datasheets.

Vendor datasheet values; dense (non-sparse) throughput.

Fields

Field	Description
`gpu`	GPU id
`variant`	Variant id
`name`	Variant name
`architecture`	GPU architecture
`form_factor`	Form factor
`memory_gb`	Device memory, GB
`memory_type`	Memory technology
`bandwidth_gbs`	Memory bandwidth, GB/s
`fp8_dense_tflops`	Dense FP8 Tensor Core TFLOPS
`bf16_dense_tflops`	Dense BF16 Tensor Core TFLOPS
`fp32_tflops`	FP32 TFLOPS
`nvlink_gbs`	NVLink bandwidth, GB/s (null if none)
`tdp`	Power envelope
`source`	Primary datasheet URL

First 6 of 6 rows.

gpu	variant	name	architecture	form_factor	memory_gb	memory_type	bandwidth_gbs	fp8_dense_tflops	bf16_dense_tflops	fp32_tflops	nvlink_gbs	tdp	source
nvidia-h100	h100-sxm	H100 SXM5	Hopper	SXM5	80	HBM3	3350	1979	989	67	900	Up to 700 W	https://www.nvidia.com/en-us/data-center/h100/
nvidia-h100	h100-pcie	H100 PCIe	Hopper	PCIe dual-slot	80	HBM2e	2000	1513	756	51	600	300–350 W	https://www.nvidia.com/en-us/data-center/h100/
nvidia-h100	h100-nvl	H100 NVL	Hopper	PCIe dual-slot	94	HBM3	3900	1670	835	60	600	350–400 W	https://www.nvidia.com/en-us/data-center/h100/
nvidia-h200	h200-sxm	H200 SXM	Hopper	SXM5	141	HBM3e	4800	1979	989	67	900	Up to 700 W	https://www.nvidia.com/en-us/data-center/h200/
nvidia-h200	h200-nvl	H200 NVL	Hopper	PCIe dual-slot	141	HBM3e	4800	1670	835	60	900	Up to 600 W	https://www.nvidia.com/en-us/data-center/h200/
nvidia-l40s	l40s	L40S	Ada Lovelace	PCIe dual-slot	48	GDDR6 (ECC)	864	733	362	91.6	—	350 W	https://www.nvidia.com/en-us/data-center/l40s/