GPU Comparison
RADEON
AMD Instinct MI300X
CORE STATE
Aqua Vanjaram
VRAM
192 GB
CLOCK SPEED
2100 MHz
TDP
750 W
BUS WIDTH
8192 bit
ARCHITECTURE
CDNA 3.0
PROCESS
5 nm
LAUNCH DATE
2023
VS
GEFORCE
Tesla T4
CORE STATE
TU104
VRAM
16 GB
CLOCK SPEED
1590 MHz
TDP
70 W
BUS WIDTH
256 bit
ARCHITECTURE
Turing
PROCESS
12 nm
LAUNCH DATE
2018
PERFORMANCE BENCHMARKS
geekbench_opencl
geekbench_vulkan
DETAILED SPECIFICATIONS
SPECIFICATION
Instinct MI300X
Tesla T4
Core Specs
Shading Units
19,456
2,560
-86.8%
Shaders
19,456
2,560
-86.8%
TMUs
1,216
160
-86.8%
ROPs
0
64
+∞%
Compute Units
304
—
SM Count
—
40
Clocks
Base Clock
1000 MHz
585 MHz
Boost Clock
2100 MHz
1590 MHz
Memory Clock
1300 MHz 5.2 Gbps effective
1250 MHz 10 Gbps effective
Memory
Memory Size
192 GB
16 GB
VRAM (MB)
196,608
16,384
-91.7%
Memory Type
HBM3
GDDR6
Memory Bus
8192 bit
256 bit
Bandwidth
5.32 TB/s
320.0 GB/s
Cache
L1 Cache
16 KB (per CU)
64 KB (per SM)
L2 Cache
16 MB
4 MB
L3 Cache
256 MB
—
Performance
Pixel Rate
0 MPixel/s
101.8 GPixel/s
Texture Rate
2,553.6 GTexel/s
254.4 GTexel/s
FP32 (TFLOPS)
81.72 TFLOPS
8.141 TFLOPS
FP64 (TFLOPS)
40.86 TFLOPS (1:2)
254.4 GFLOPS (1:32)
FP16 (TFLOPS)
81.72 TFLOPS (1:1)
16.28 TFLOPS (2:1)
AI/RT
RT Cores
—
40
Tensor Cores
—
320
Matrix Cores
1,216
—
Power
TDP
750 W
70 W
TDP (W)
750
70
-90.7%
Suggested PSU
1150 W
250 W
Power Connectors
None
None
Architecture
Architecture
CDNA 3.0
Turing
GPU Name
Aqua Vanjaram
TU104
Generation
Instinct (MIx)
Tesla Turing (Txx)
Process Size
5 nm
12 nm
Transistors
153,000 million
13,600 million
Die Size
1017 mm²
545 mm²
Foundry
TSMC
TSMC
Density
150.4M / mm²
25.0M / mm²
AMD MCM
MCM
2
—
API Support
DirectX
—
12 Ultimate (12_2)
OpenGL
—
4.6
Vulkan
—
1.4
OpenCL
3.0
3.0
CUDA
—
7.5
Shader Model
—
6.9
Physical
Slot Width
OAM Module
Single-slot
Length
—
168 mm 6.6 inches
Outputs
No outputs
No outputs
Bus Interface
PCIe 5.0 x16
PCIe 3.0 x16
Other
Production
—
End-of-life
Predecessor
Radeon Instinct
Tesla Volta
Successor
—
Server Ampere