GPU Comparison

A

AMD

RADEON

AMD Instinct MI300X

CORE STATE Aqua Vanjaram

VRAM 192 GB

CLOCK SPEED 2100 MHz

TDP 750 W

BUS WIDTH 8192 bit

ARCHITECTURE CDNA 3.0

nm

PROCESS 5 nm

LAUNCH DATE 2023

VS

NVIDIA

GEFORCE

Quadro RTX 6000

CORE STATE TU102

VRAM 24 GB

CLOCK SPEED 1770 MHz

TDP 260 W

BUS WIDTH 384 bit

ARCHITECTURE Turing

nm

PROCESS 12 nm

LAUNCH DATE 2018

PERFORMANCE BENCHMARKS

geekbench_opencl

317,994

74,179

geekbench_vulkan

N/A

129,564

DETAILED SPECIFICATIONS

SPECIFICATION

Instinct MI300X

Quadro RTX 6000

Core Specs

Shading Units

19,456

4,608 -76.3%

Shaders

19,456

4,608 -76.3%

TMUs

1,216

288 -76.3%

ROPs

0

96 +∞%

Compute Units

304

—

SM Count

—

72

Clocks

Base Clock

1000 MHz

1440 MHz

Boost Clock

2100 MHz

1770 MHz

Memory Clock

1300 MHz 5.2 Gbps effective

1750 MHz 14 Gbps effective

Memory

Memory Size

192 GB

24 GB

VRAM (MB)

196,608

24,576 -87.5%

Memory Type

HBM3

GDDR6

Memory Bus

8192 bit

384 bit

Bandwidth

5.32 TB/s

672.0 GB/s

Cache

L1 Cache

16 KB (per CU)

64 KB (per SM)

L2 Cache

16 MB

6 MB

L3 Cache

256 MB

—

Performance

Pixel Rate

0 MPixel/s

169.9 GPixel/s

Texture Rate

2,553.6 GTexel/s

509.8 GTexel/s

FP32 (TFLOPS)

81.72 TFLOPS

16.31 TFLOPS

FP64 (TFLOPS)

40.86 TFLOPS (1:2)

509.8 GFLOPS (1:32)

FP16 (TFLOPS)

81.72 TFLOPS (1:1)

32.62 TFLOPS (2:1)

AI/RT

RT Cores

—

72

Tensor Cores

—

576

Matrix Cores

1,216

—

Power

TDP

750 W

260 W

TDP (W)

750

260 -65.3%

Suggested PSU

1150 W

600 W

Power Connectors

None

1x 6-pin + 1x 8-pin

Architecture

Architecture

CDNA 3.0

Turing

GPU Name

Aqua Vanjaram

TU102

Generation

Instinct (MIx)

Quadro Turing (Tx000)

Process Size

5 nm

12 nm

Transistors

153,000 million

18,600 million

Die Size

1017 mm²

754 mm²

Foundry

TSMC

TSMC

Density

150.4M / mm²

24.7M / mm²

AMD MCM

MCM

2

—

API Support

DirectX

—

12 Ultimate (12_2)

OpenGL

—

4.6

Vulkan

—

1.4

OpenCL

3.0

3.0

CUDA

—

7.5

Shader Model

—

6.8

Physical

Slot Width

OAM Module

Dual-slot

Length

—

267 mm 10.5 inches

Height

—

111 mm 4.4 inches

Outputs

No outputs

4x DisplayPort 1.4a1x USB Type-C

Bus Interface

PCIe 5.0 x16

PCIe 3.0 x16

Other

Launch Price

—

6,299 USD

Production

—

End-of-life

Predecessor

Radeon Instinct

Quadro Volta

Successor

—

Workstation Ampere

View Instinct MI300X Details View Quadro RTX 6000 Details