GPU Comparison

NVIDIA

GEFORCE

NVIDIA H200 NVL

CORE STATE GH100

VRAM 141 GB

CLOCK SPEED 1785 MHz

TDP 600 W

BUS WIDTH 6144 bit

ARCHITECTURE Hopper

nm

PROCESS 5 nm

LAUNCH DATE 2024

VS

NVIDIA

GEFORCE

RTX A6000

CORE STATE GA102

VRAM 48 GB

CLOCK SPEED 1800 MHz

TDP 300 W

BUS WIDTH 384 bit

ARCHITECTURE Ampere

nm

PROCESS 8 nm

LAUNCH DATE 2020

PERFORMANCE BENCHMARKS

geekbench_opencl

305,608

180,149

geekbench_vulkan

N/A

165,451

passmark_directx_10

N/A

155

passmark_directx_11

N/A

191

passmark_directx_12

N/A

87

passmark_directx_9

N/A

245

passmark_g2d

N/A

913

passmark_g3d

N/A

22,577

passmark_gpu_compute

N/A

14,110

DETAILED SPECIFICATIONS

SPECIFICATION

H200 NVL

RTX A6000

Core Specs

Shading Units

16,896

10,752 -36.4%

Shaders

16,896

10,752 -36.4%

TMUs

528

336 -36.4%

ROPs

24

112 +366.7%

SM Count

132

84 -36.4%

Clocks

Base Clock

1365 MHz

1410 MHz

Boost Clock

1785 MHz

1800 MHz

Memory Clock

1593 MHz 6.4 Gbps effective

2000 MHz 16 Gbps effective

Memory

Memory Size

141 GB

48 GB

VRAM (MB)

144,384

49,152 -66.0%

Memory Type

HBM3e

GDDR6

Memory Bus

6144 bit

384 bit

Bandwidth

4.89 TB/s

768.0 GB/s

Cache

L1 Cache

256 KB (per SM)

128 KB (per SM)

L2 Cache

50 MB

6 MB

Performance

Pixel Rate

42.84 GPixel/s

201.6 GPixel/s

Texture Rate

942.5 GTexel/s

604.8 GTexel/s

FP32 (TFLOPS)

60.32 TFLOPS

38.71 TFLOPS

FP64 (TFLOPS)

30.16 TFLOPS (1:2)

604.8 GFLOPS (1:64)

FP16 (TFLOPS)

241.3 TFLOPS (4:1)

38.71 TFLOPS (1:1)

AI/RT

RT Cores

—

84

Tensor Cores

528

336 -36.4%

Power

TDP

600 W

300 W

TDP (W)

600

300 -50.0%

Suggested PSU

1000 W

700 W

Power Connectors

8-pin EPS

8-pin EPS

Architecture

Architecture

Hopper

Ampere

GPU Name

GH100

GA102

Generation

Server Hopper (Hxx)

Workstation Ampere (Ax000)

Process Size

5 nm

8 nm

Transistors

80,000 million

28,300 million

Die Size

814 mm²

628 mm²

Foundry

TSMC

Samsung

Density

98.3M / mm²

45.1M / mm²

API Support

DirectX

—

12 Ultimate (12_2)

OpenGL

—

4.6

Vulkan

—

1.4

OpenCL

3.0

3.0

CUDA

9.0

8.6

Shader Model

—

6.8

Physical

Slot Width

Dual-slot

Dual-slot

Length

267 mm 10.5 inches

267 mm 10.5 inches

Height

111 mm 4.4 inches

112 mm 4.4 inches

Outputs

No outputs

4x DisplayPort 1.4a

Bus Interface

PCIe 5.0 x16

PCIe 4.0 x16

Other

Launch Price

—

4,649 USD

Production

Active

End-of-life

Predecessor

Server Ada

Quadro Turing

Successor

Server Blackwell

Workstation Ada

View H200 NVL Details View RTX A6000 Details