GPU Comparison
GEFORCE
NVIDIA H200 NVL
CORE STATE
GH100
VRAM
141 GB
CLOCK SPEED
1785 MHz
TDP
600 W
BUS WIDTH
6144 bit
ARCHITECTURE
Hopper
PROCESS
5 nm
LAUNCH DATE
2024
VS
GEFORCE
Tesla T4
CORE STATE
TU104
VRAM
16 GB
CLOCK SPEED
1590 MHz
TDP
70 W
BUS WIDTH
256 bit
ARCHITECTURE
Turing
PROCESS
12 nm
LAUNCH DATE
2018
PERFORMANCE BENCHMARKS
geekbench_opencl
geekbench_vulkan
DETAILED SPECIFICATIONS
SPECIFICATION
H200 NVL
Tesla T4
Core Specs
Shading Units
16,896
2,560
-84.8%
Shaders
16,896
2,560
-84.8%
TMUs
528
160
-69.7%
ROPs
24
64
+166.7%
SM Count
132
40
-69.7%
Clocks
Base Clock
1365 MHz
585 MHz
Boost Clock
1785 MHz
1590 MHz
Memory Clock
1593 MHz
6.4 Gbps effective
1250 MHz
10 Gbps effective
Memory
Memory Size
141 GB
16 GB
VRAM (MB)
144,384
16,384
-88.7%
Memory Type
HBM3e
GDDR6
Memory Bus
6144 bit
256 bit
Bandwidth
4.89 TB/s
320.0 GB/s
Cache
L1 Cache
256 KB (per SM)
64 KB (per SM)
L2 Cache
50 MB
4 MB
Performance
Pixel Rate
42.84 GPixel/s
101.8 GPixel/s
Texture Rate
942.5 GTexel/s
254.4 GTexel/s
FP32 (TFLOPS)
60.32 TFLOPS
8.141 TFLOPS
FP64 (TFLOPS)
30.16 TFLOPS (1:2)
254.4 GFLOPS (1:32)
FP16 (TFLOPS)
241.3 TFLOPS (4:1)
65.13 TFLOPS (8:1)
AI/RT
RT Cores
—
40
Tensor Cores
528
320
-39.4%
Power
TDP
600 W
70 W
TDP (W)
600
70
-88.3%
Suggested PSU
1000 W
250 W
Power Connectors
8-pin EPS
None
Architecture
Architecture
Hopper
Turing
GPU Name
GH100
TU104
Generation
Server Hopper
(Hxx)
Tesla Turing
(Txx)
Process Size
5 nm
12 nm
Transistors
80,000 million
13,600 million
Die Size
814 mm²
545 mm²
Foundry
TSMC
TSMC
Density
98.3M / mm²
25.0M / mm²
API Support
DirectX
—
12 Ultimate (12_2)
OpenGL
—
4.6
Vulkan
—
1.4
OpenCL
3.0
3.0
CUDA
9.0
7.5
Shader Model
—
6.8
Physical
Slot Width
Dual-slot
Single-slot
Length
267 mm
10.5 inches
168 mm
6.6 inches
Height
111 mm
4.4 inches
—
Outputs
No outputs
No outputs
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x16
Other
Production
Active
End-of-life
Predecessor
Server Ada
Tesla Volta
Successor
Server Blackwell
Server Ampere