GPU Comparison

NVIDIA

GEFORCE

NVIDIA H200 NVL

CORE STATE GH100

VRAM 141 GB

CLOCK SPEED 1785 MHz

TDP 600 W

BUS WIDTH 6144 bit

ARCHITECTURE Hopper

nm

PROCESS 5 nm

LAUNCH DATE 2024

VS

NVIDIA

GEFORCE

RTX A4000 Mobile

CORE STATE GA104

VRAM 8 GB

CLOCK SPEED 1680 MHz

TDP 115 W

BUS WIDTH 256 bit

ARCHITECTURE Ampere

nm

PROCESS 8 nm

LAUNCH DATE 2021

PERFORMANCE BENCHMARKS

geekbench_opencl

305,608

97,178

geekbench_vulkan

N/A

73,002

passmark_directx_10

N/A

105

passmark_directx_11

N/A

127

passmark_directx_12

N/A

66

passmark_directx_9

N/A

157

passmark_g2d

N/A

585

passmark_g3d

N/A

14,796

passmark_gpu_compute

N/A

6,394

DETAILED SPECIFICATIONS

SPECIFICATION

H200 NVL

RTX A4000 Mobile

Core Specs

Shading Units

16,896

5,120 -69.7%

Shaders

16,896

5,120 -69.7%

TMUs

528

160 -69.7%

ROPs

24

80 +233.3%

SM Count

132

40 -69.7%

Clocks

Base Clock

1365 MHz

1140 MHz

Boost Clock

1785 MHz

1680 MHz

Memory Clock

1593 MHz 6.4 Gbps effective

1500 MHz 12 Gbps effective

Memory

Memory Size

141 GB

8 GB

VRAM (MB)

144,384

8,192 -94.3%

Memory Type

HBM3e

GDDR6

Memory Bus

6144 bit

256 bit

Bandwidth

4.89 TB/s

384.0 GB/s

Cache

L1 Cache

256 KB (per SM)

128 KB (per SM)

L2 Cache

50 MB

4 MB

Performance

Pixel Rate

42.84 GPixel/s

134.4 GPixel/s

Texture Rate

942.5 GTexel/s

268.8 GTexel/s

FP32 (TFLOPS)

60.32 TFLOPS

17.20 TFLOPS

FP64 (TFLOPS)

30.16 TFLOPS (1:2)

268.8 GFLOPS (1:64)

FP16 (TFLOPS)

241.3 TFLOPS (4:1)

17.20 TFLOPS (1:1)

AI/RT

RT Cores

—

40

Tensor Cores

528

160 -69.7%

Power

TDP

600 W

115 W

TDP (W)

600

115 -80.8%

Suggested PSU

1000 W

—

Power Connectors

8-pin EPS

None

Architecture

Architecture

Hopper

Ampere

GPU Name

GH100

GA104

Generation

Server Hopper (Hxx)

Ampere-MW (Ax000)

Process Size

5 nm

8 nm

Transistors

80,000 million

17,400 million

Die Size

814 mm²

392 mm²

Foundry

TSMC

Samsung

Density

98.3M / mm²

44.4M / mm²

API Support

DirectX

—

12 Ultimate (12_2)

OpenGL

—

4.6

Vulkan

—

1.4

OpenCL

3.0

3.0

CUDA

9.0

8.6

Shader Model

—

6.8

Physical

Slot Width

Dual-slot

—

Length

267 mm 10.5 inches

—

Height

111 mm 4.4 inches

—

Outputs

No outputs

Portable Device Dependent

Bus Interface

PCIe 5.0 x16

PCIe 4.0 x16

Other

Production

Active

End-of-life

Predecessor

Server Ada

Quadro Turing-M

Successor

Server Blackwell

Ada-MW

View H200 NVL Details View RTX A4000 Mobile Details