GPU Comparison
GEFORCE
NVIDIA H200 NVL
CORE STATE
GH100
VRAM
141 GB
CLOCK SPEED
1785 MHz
TDP
600 W
BUS WIDTH
6144 bit
ARCHITECTURE
Hopper
PROCESS
5 nm
LAUNCH DATE
2024
VS
GEFORCE
Tesla P40
CORE STATE
GP102
VRAM
24 GB
CLOCK SPEED
1531 MHz
TDP
250 W
BUS WIDTH
384 bit
ARCHITECTURE
Pascal
PROCESS
16 nm
LAUNCH DATE
2016
PERFORMANCE BENCHMARKS
geekbench_opencl
geekbench_vulkan
DETAILED SPECIFICATIONS
SPECIFICATION
H200 NVL
Tesla P40
Core Specs
Shading Units
16,896
3,840
-77.3%
Shaders
16,896
3,840
-77.3%
TMUs
528
240
-54.5%
ROPs
24
96
+300.0%
SM Count
132
30
-77.3%
Clocks
Base Clock
1365 MHz
1303 MHz
Boost Clock
1785 MHz
1531 MHz
Memory Clock
1593 MHz
6.4 Gbps effective
1808 MHz
7.2 Gbps effective
Memory
Memory Size
141 GB
24 GB
VRAM (MB)
144,384
24,576
-83.0%
Memory Type
HBM3e
GDDR5
Memory Bus
6144 bit
384 bit
Bandwidth
4.89 TB/s
347.1 GB/s
Cache
L1 Cache
256 KB (per SM)
48 KB (per SM)
L2 Cache
50 MB
3 MB
Performance
Pixel Rate
42.84 GPixel/s
147.0 GPixel/s
Texture Rate
942.5 GTexel/s
367.4 GTexel/s
FP32 (TFLOPS)
60.32 TFLOPS
11.76 TFLOPS
FP64 (TFLOPS)
30.16 TFLOPS (1:2)
367.4 GFLOPS (1:32)
FP16 (TFLOPS)
241.3 TFLOPS (4:1)
183.7 GFLOPS (1:64)
AI/RT
Tensor Cores
528
—
Power
TDP
600 W
250 W
TDP (W)
600
250
-58.3%
Suggested PSU
1000 W
600 W
Power Connectors
8-pin EPS
8-pin EPS
Architecture
Architecture
Hopper
Pascal
GPU Name
GH100
GP102
Generation
Server Hopper
(Hxx)
Tesla Pascal
(Pxx)
Process Size
5 nm
16 nm
Transistors
80,000 million
11,800 million
Die Size
814 mm²
471 mm²
Foundry
TSMC
TSMC
Density
98.3M / mm²
25.1M / mm²
API Support
DirectX
—
12 (12_1)
OpenGL
—
4.6
Vulkan
—
1.4
OpenCL
3.0
3.0
CUDA
9.0
6.1
Shader Model
—
6.8
Physical
Slot Width
Dual-slot
Dual-slot
Length
267 mm
10.5 inches
267 mm
10.5 inches
Height
111 mm
4.4 inches
111 mm
4.4 inches
Outputs
No outputs
No outputs
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x16
Other
Launch Price
—
5,699 USD
Production
Active
End-of-life
Predecessor
Server Ada
Tesla Maxwell
Successor
Server Blackwell
Tesla Volta