GEFORCE

NVIDIA H200 NVL

NVIDIA graphics card specifications and benchmark scores

141 GB
VRAM
1785
MHz Boost
600W
TDP
6144
Bus Width
🤖Tensor Cores

NVIDIA H200 NVL Specifications

⚙️

H200 NVL GPU Core

Shader units and compute resources

The NVIDIA H200 NVL GPU core specifications define its raw processing power for graphics and compute workloads. Shading units (also called CUDA cores, stream processors, or execution units depending on manufacturer) handle the parallel calculations required for rendering. TMUs (Texture Mapping Units) process texture data, while ROPs (Render Output Units) handle final pixel output. Higher shader counts generally translate to better GPU benchmark performance, especially in demanding games and 3D applications.

Shading Units
16,896
Shaders
16,896
TMUs
528
ROPs
24
SM Count
132
⏱️

H200 NVL Clock Speeds

GPU and memory frequencies

Clock speeds directly impact the H200 NVL's performance in GPU benchmarks and real-world gaming. The base clock represents the minimum guaranteed frequency, while the boost clock indicates peak performance under optimal thermal conditions. Memory clock speed affects texture loading and frame buffer operations. The H200 NVL by NVIDIA dynamically adjusts frequencies based on workload, temperature, and power limits to maximize performance while maintaining stability.

Base Clock
1365 MHz
Base Clock
1,365 MHz
Boost Clock
1785 MHz
Boost Clock
1,785 MHz
Memory Clock
1593 MHz 6.4 Gbps effective
GDDR GDDR 6X 6X

NVIDIA's H200 NVL Memory

VRAM capacity and bandwidth

VRAM (Video RAM) is dedicated memory for storing textures, frame buffers, and shader data. The H200 NVL's memory capacity determines how well it handles high-resolution textures and multiple displays. Memory bandwidth, measured in GB/s, affects how quickly data moves between the GPU and VRAM. Higher bandwidth improves performance in memory-intensive scenarios like 4K gaming. The memory bus width and type (GDDR6, GDDR6X, HBM) significantly influence overall GPU benchmark scores.

Memory Size
141 GB
VRAM
144,384 MB
Memory Type
HBM3e
VRAM Type
HBM3e
Memory Bus
6144 bit
Bus Width
6144-bit
Bandwidth
4.89 TB/s
💾

H200 NVL by NVIDIA Cache

On-chip cache hierarchy

On-chip cache provides ultra-fast data access for the H200 NVL, reducing the need to fetch data from slower VRAM. L1 and L2 caches store frequently accessed data close to the compute units. AMD's Infinity Cache (L3) dramatically increases effective bandwidth, improving GPU benchmark performance without requiring wider memory buses. Larger cache sizes help maintain high frame rates in memory-bound scenarios and reduce power consumption by minimizing VRAM accesses.

L1 Cache
256 KB (per SM)
L2 Cache
50 MB
📈

H200 NVL Theoretical Performance

Compute and fill rates

Theoretical performance metrics provide a baseline for comparing the NVIDIA H200 NVL against other graphics cards. FP32 (single-precision) performance, measured in TFLOPS, indicates compute capability for gaming and general GPU workloads. FP64 (double-precision) matters for scientific computing. Pixel and texture fill rates determine how quickly the GPU can render complex scenes. While real-world GPU benchmark results depend on many factors, these specifications help predict relative performance levels.

FP32 (Float)
60.32 TFLOPS
FP64 (Double)
30.16 TFLOPS (1:2)
FP16 (Half)
241.3 TFLOPS (4:1)
Pixel Rate
42.84 GPixel/s
Texture Rate
942.5 GTexel/s

H200 NVL Ray Tracing & AI

Hardware acceleration features

The NVIDIA H200 NVL includes dedicated hardware for ray tracing and AI acceleration. RT cores handle real-time ray tracing calculations for realistic lighting, reflections, and shadows in supported games. Tensor cores (NVIDIA) or XMX cores (Intel) accelerate AI workloads including DLSS, FSR, and XeSS upscaling technologies. These features enable higher visual quality without proportional performance costs, making the H200 NVL capable of delivering both stunning graphics and smooth frame rates in modern titles.

Tensor Cores
528
🏗️

Hopper Architecture & Process

Manufacturing and design details

The NVIDIA H200 NVL is built on NVIDIA's Hopper architecture, which defines how the GPU processes graphics and compute workloads. The manufacturing process node affects power efficiency, thermal characteristics, and maximum clock speeds. Smaller process nodes pack more transistors into the same die area, enabling higher performance per watt. Understanding the architecture helps predict how the H200 NVL will perform in GPU benchmarks compared to previous generations.

Architecture
Hopper
GPU Name
GH100
Process Node
5 nm
Foundry
TSMC
Transistors
80,000 million
Die Size
814 mm²
Density
98.3M / mm²
🔌

NVIDIA's H200 NVL Power & Thermal

TDP and power requirements

Power specifications for the NVIDIA H200 NVL determine PSU requirements and thermal management needs. TDP (Thermal Design Power) indicates the heat output under typical loads, guiding cooler selection. Power connector requirements ensure adequate power delivery for stable operation during demanding GPU benchmarks. The suggested PSU wattage accounts for the entire system, not just the graphics card. Efficient power delivery enables the H200 NVL to maintain boost clocks without throttling.

TDP
600 W
TDP
600W
Power Connectors
8-pin EPS
Suggested PSU
1000 W
📐

H200 NVL by NVIDIA Physical & Connectivity

Dimensions and outputs

Physical dimensions of the NVIDIA H200 NVL are critical for case compatibility. Card length, height, and slot width determine whether it fits in your chassis. The PCIe interface version affects bandwidth for communication with the CPU. Display outputs define monitor connectivity options, with modern cards supporting multiple high-resolution displays simultaneously. Verify these specifications against your case and motherboard before purchasing to ensure a proper fit.

Slot Width
Dual-slot
Length
267 mm 10.5 inches
Height
111 mm 4.4 inches
Bus Interface
PCIe 5.0 x16
Display Outputs
No outputs
Display Outputs
No outputs
🎮

NVIDIA API Support

Graphics and compute APIs

API support determines which games and applications can fully utilize the NVIDIA H200 NVL. DirectX 12 Ultimate enables advanced features like ray tracing and variable rate shading. Vulkan provides cross-platform graphics capabilities with low-level hardware access. OpenGL remains important for professional applications and older games. CUDA (NVIDIA) and OpenCL enable GPU compute for video editing, 3D rendering, and scientific applications. Higher API versions unlock newer graphical features in GPU benchmarks and games.

OpenCL
3.0
CUDA
9.0
📦

H200 NVL Product Information

Release and pricing details

The NVIDIA H200 NVL is manufactured by NVIDIA as part of their graphics card lineup. Release date and launch pricing provide context for comparing GPU benchmark results with competing products from the same era. Understanding the product lifecycle helps evaluate whether the H200 NVL by NVIDIA represents good value at current market prices. Predecessor and successor information aids in tracking generational improvements and planning future upgrades.

Manufacturer
NVIDIA
Release Date
Nov 2024
Production
Active
Predecessor
Server Ada
Successor
Server Blackwell

H200 NVL Benchmark Scores

geekbench_openclSource

Geekbench OpenCL tests GPU compute performance using the cross-platform OpenCL API. This shows how NVIDIA H200 NVL handles parallel computing tasks like video encoding and scientific simulations.

geekbench_opencl #8 of 582
305,608
80%
Max: 380,114
Compare with other GPUs

About NVIDIA H200 NVL

The NVIDIA H200 NVL is an absolute beast when it comes to raw compute performance, flexing serious muscle with its 141 GB of HBM3e memory and a Geekbench OpenCL score of 305,608 points. Built on the cutting-edge 5 nm Hopper architecture, this GPU doesn't just handle heavy workloads it obliterates them, whether you're training massive AI models or running ultra-complex simulations. With a boost clock hitting 1785 MHz and a PCIe 5.0 x16 interface, data moves at lightspeed, minimizing bottlenecks in high-throughput environments. The 600W TDP might sound intense, but that's the price of delivering next-gen parallel processing power at this scale. This isn’t just an upgrade it’s a complete redefinition of what a data center GPU can do.

For video editing beasts working with 8K RAW or multi-layered timelines in DaVinci Resolve and Adobe Premiere Pro, the NVIDIA H200 NVL makes rendering feel instant. That mountain of 141 GB VRAM means you can cache entire projects in memory without sweating, and the HBM3e bandwidth keeps playback buttery smooth even with effects stacked ten deep. Real-time AI enhancements like noise reduction, upscaling, and scene detection fly by thanks to dedicated tensor cores optimized in the Hopper design. Whether you're color grading in HDR or exporting for IMAX, this card cuts export times like scissors through paper. It’s not just fast it’s “your render queue is now shorter than your coffee break” fast.

When it comes to enterprise features and software compatibility, this card plays elite. From full support for NVIDIA’s AI Enterprise suite to seamless integration with Kubernetes and VMware for virtualized GPU workloads, the H200 NVL is built for big-league infrastructures. Developers get CUDA, TensorRT, and support for major ML frameworks like PyTorch and TensorFlow, all optimized to leverage that insane memory bandwidth. Security? Locked in with hardware-based isolation and secure boot. NVIDIA’s H200 NVL graphics aren’t just for gamers pretending to be professionals they’re purpose-built for organizations pushing the limits of AI, HPC, and real-time analytics at scale.

The AMD Equivalent of H200 NVL

Looking for a similar graphics card from AMD? The AMD Radeon RX 7800M offers comparable performance and features in the AMD lineup.

AMD Radeon RX 7800M

AMD • 12 GB VRAM

View Specs Compare

Popular NVIDIA H200 NVL Comparisons

See how the H200 NVL stacks up against similar graphics cards from the same generation and competing brands.

Compare H200 NVL with Other GPUs

Select another GPU to compare specifications and benchmarks side-by-side.

Browse GPUs