GPU Comparison
GEFORCE
NVIDIA H200 NVL
CORE STATE
GH100
VRAM
141 GB
CLOCK SPEED
1785 MHz
TDP
600 W
BUS WIDTH
6144 bit
ARCHITECTURE
Hopper
PROCESS
5 nm
LAUNCH DATE
2024
VS
GEFORCE
RTX 4000 Ada Generation
CORE STATE
AD104
VRAM
20 GB
CLOCK SPEED
2175 MHz
TDP
130 W
BUS WIDTH
160 bit
ARCHITECTURE
Ada Lovelace
PROCESS
5 nm
LAUNCH DATE
2023
PERFORMANCE BENCHMARKS
geekbench_opencl
geekbench_vulkan
DETAILED SPECIFICATIONS
SPECIFICATION
H200 NVL
RTX 4000 Ada Generation
Core Specs
Shading Units
16,896
6,144
-63.6%
Shaders
16,896
6,144
-63.6%
TMUs
528
192
-63.6%
ROPs
24
64
+166.7%
SM Count
132
48
-63.6%
Clocks
Base Clock
1365 MHz
1500 MHz
Boost Clock
1785 MHz
2175 MHz
Memory Clock
1593 MHz
6.4 Gbps effective
2250 MHz
18 Gbps effective
Memory
Memory Size
141 GB
20 GB
VRAM (MB)
144,384
20,480
-85.8%
Memory Type
HBM3e
GDDR6
Memory Bus
6144 bit
160 bit
Bandwidth
4.89 TB/s
360.0 GB/s
Cache
L1 Cache
256 KB (per SM)
128 KB (per SM)
L2 Cache
50 MB
48 MB
Performance
Pixel Rate
42.84 GPixel/s
139.2 GPixel/s
Texture Rate
942.5 GTexel/s
417.6 GTexel/s
FP32 (TFLOPS)
60.32 TFLOPS
26.73 TFLOPS
FP64 (TFLOPS)
30.16 TFLOPS (1:2)
417.6 GFLOPS (1:64)
FP16 (TFLOPS)
241.3 TFLOPS (4:1)
26.73 TFLOPS (1:1)
AI/RT
RT Cores
—
48
Tensor Cores
528
192
-63.6%
Power
TDP
600 W
130 W
TDP (W)
600
130
-78.3%
Suggested PSU
1000 W
300 W
Power Connectors
8-pin EPS
1x 16-pin
Architecture
Architecture
Hopper
Ada Lovelace
GPU Name
GH100
AD104
Generation
Server Hopper
(Hxx)
Workstation Ada
(x000A)
Process Size
5 nm
5 nm
Transistors
80,000 million
35,800 million
Die Size
814 mm²
294 mm²
Foundry
TSMC
TSMC
Density
98.3M / mm²
121.8M / mm²
API Support
DirectX
—
12 Ultimate (12_2)
OpenGL
—
4.6
Vulkan
—
1.4
OpenCL
3.0
3.0
CUDA
9.0
8.9
Shader Model
—
6.8
Physical
Slot Width
Dual-slot
Single-slot
Length
267 mm
10.5 inches
245 mm
9.6 inches
Height
111 mm
4.4 inches
112 mm
4.4 inches
Outputs
No outputs
4x DisplayPort 1.4a
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x16
Other
Production
Active
Active
Predecessor
Server Ada
Workstation Ampere
Successor
Server Blackwell
Blackwell PRO W