GPU Comparison
GEFORCE
NVIDIA H200 NVL
CORE STATE
GH100
VRAM
141 GB
CLOCK SPEED
1785 MHz
TDP
600 W
BUS WIDTH
6144 bit
ARCHITECTURE
Hopper
PROCESS
5 nm
LAUNCH DATE
2024
VS
GEFORCE
RTX A400
CORE STATE
GA107
VRAM
4 GB
CLOCK SPEED
1762 MHz
TDP
50 W
BUS WIDTH
64 bit
ARCHITECTURE
Ampere
PROCESS
8 nm
LAUNCH DATE
2024
PERFORMANCE BENCHMARKS
geekbench_opencl
geekbench_vulkan
DETAILED SPECIFICATIONS
SPECIFICATION
H200 NVL
RTX A400
Core Specs
Shading Units
16,896
768
-95.5%
Shaders
16,896
768
-95.5%
TMUs
528
24
-95.5%
ROPs
24
16
-33.3%
SM Count
132
6
-95.5%
Clocks
Base Clock
1365 MHz
1417 MHz
Boost Clock
1785 MHz
1762 MHz
Memory Clock
1593 MHz
6.4 Gbps effective
1500 MHz
12 Gbps effective
Memory
Memory Size
141 GB
4 GB
VRAM (MB)
144,384
4,096
-97.2%
Memory Type
HBM3e
GDDR6
Memory Bus
6144 bit
64 bit
Bandwidth
4.89 TB/s
96.00 GB/s
Cache
L1 Cache
256 KB (per SM)
128 KB (per SM)
L2 Cache
50 MB
2 MB
Performance
Pixel Rate
42.84 GPixel/s
28.19 GPixel/s
Texture Rate
942.5 GTexel/s
42.29 GTexel/s
FP32 (TFLOPS)
60.32 TFLOPS
2.706 TFLOPS
FP64 (TFLOPS)
30.16 TFLOPS (1:2)
42.29 GFLOPS (1:64)
FP16 (TFLOPS)
241.3 TFLOPS (4:1)
2.706 TFLOPS (1:1)
AI/RT
RT Cores
—
6
Tensor Cores
528
24
-95.5%
Power
TDP
600 W
50 W
TDP (W)
600
50
-91.7%
Suggested PSU
1000 W
250 W
Power Connectors
8-pin EPS
None
Architecture
Architecture
Hopper
Ampere
GPU Name
GH100
GA107
Generation
Server Hopper
(Hxx)
Workstation Ampere
(Ax000)
Process Size
5 nm
8 nm
Transistors
80,000 million
8,700 million
Die Size
814 mm²
200 mm²
Foundry
TSMC
Samsung
Density
98.3M / mm²
43.5M / mm²
API Support
DirectX
—
12 Ultimate (12_2)
OpenGL
—
4.6
Vulkan
—
1.4
OpenCL
3.0
3.0
CUDA
9.0
8.6
Shader Model
—
6.8
Physical
Slot Width
Dual-slot
Single-slot
Length
267 mm
10.5 inches
163 mm
6.4 inches
Height
111 mm
4.4 inches
69 mm
2.7 inches
Outputs
No outputs
4x mini-DisplayPort 1.4a
Bus Interface
PCIe 5.0 x16
PCIe 4.0 x8
Other
Production
Active
Active
Predecessor
Server Ada
Quadro Turing
Successor
Server Blackwell
Workstation Ada