GPU Comparison

A

AMD

RADEON

AMD Instinct MI300X

CORE STATE Aqua Vanjaram

VRAM 192 GB

CLOCK SPEED 2100 MHz

TDP 750 W

BUS WIDTH 8192 bit

ARCHITECTURE CDNA 3.0

nm

PROCESS 5 nm

LAUNCH DATE 2023

VS

NVIDIA

GEFORCE

RTX A5000

CORE STATE GA102

VRAM 24 GB

CLOCK SPEED 1695 MHz

TDP 230 W

BUS WIDTH 384 bit

ARCHITECTURE Ampere

nm

PROCESS 8 nm

LAUNCH DATE 2021

PERFORMANCE BENCHMARKS

geekbench_opencl

317,994

157,905

3dmark_3dmark_steel_nomad_dx12

N/A

3,783

geekbench_vulkan

N/A

137,828

passmark_directx_10

N/A

153

passmark_directx_11

N/A

187

passmark_directx_12

N/A

87

passmark_directx_9

N/A

251

passmark_g2d

N/A

1,032

passmark_g3d

N/A

22,541

passmark_gpu_compute

N/A

12,455

DETAILED SPECIFICATIONS

SPECIFICATION

Instinct MI300X

RTX A5000

Core Specs

Shading Units

19,456

8,192 -57.9%

Shaders

19,456

8,192 -57.9%

TMUs

1,216

256 -78.9%

ROPs

0

96 +∞%

Compute Units

304

—

SM Count

—

64

Clocks

Base Clock

1000 MHz

1170 MHz

Boost Clock

2100 MHz

1695 MHz

Memory Clock

1300 MHz 5.2 Gbps effective

2000 MHz 16 Gbps effective

Memory

Memory Size

192 GB

24 GB

VRAM (MB)

196,608

24,576 -87.5%

Memory Type

HBM3

GDDR6

Memory Bus

8192 bit

384 bit

Bandwidth

5.32 TB/s

768.0 GB/s

Cache

L1 Cache

16 KB (per CU)

128 KB (per SM)

L2 Cache

16 MB

6 MB

L3 Cache

256 MB

—

Performance

Pixel Rate

0 MPixel/s

162.7 GPixel/s

Texture Rate

2,553.6 GTexel/s

433.9 GTexel/s

FP32 (TFLOPS)

81.72 TFLOPS

27.77 TFLOPS

FP64 (TFLOPS)

40.86 TFLOPS (1:2)

433.9 GFLOPS (1:64)

FP16 (TFLOPS)

81.72 TFLOPS (1:1)

27.77 TFLOPS (1:1)

AI/RT

RT Cores

—

64

Tensor Cores

—

256

Matrix Cores

1,216

—

Power

TDP

750 W

230 W

TDP (W)

750

230 -69.3%

Suggested PSU

1150 W

550 W

Power Connectors

None

1x 8-pin

Architecture

Architecture

CDNA 3.0

Ampere

GPU Name

Aqua Vanjaram

GA102

Generation

Instinct (MIx)

Workstation Ampere (Ax000)

Process Size

5 nm

8 nm

Transistors

153,000 million

28,300 million

Die Size

1017 mm²

628 mm²

Foundry

TSMC

Samsung

Density

150.4M / mm²

45.1M / mm²

AMD MCM

MCM

2

—

API Support

DirectX

—

12 Ultimate (12_2)

OpenGL

—

4.6

Vulkan

—

1.4

OpenCL

3.0

3.0

CUDA

—

8.6

Shader Model

—

6.8

Physical

Slot Width

OAM Module

Dual-slot

Length

—

267 mm 10.5 inches

Height

—

112 mm 4.4 inches

Outputs

No outputs

4x DisplayPort 1.4a

Bus Interface

PCIe 5.0 x16

PCIe 4.0 x16

Other

Production

—

End-of-life

Predecessor

Radeon Instinct

Quadro Turing

Successor

—

Workstation Ada

View Instinct MI300X Details View RTX A5000 Details