H100 80G — what LLMs can it run?

How this list is built

Each row is the lowest-perplexity-loss quant of that model whose estimated total — weights plus KV cache at 4K context plus activation buffer — uses at most 88% of the card. That is the calculator's "green" threshold, so every row here has real headroom rather than only just fitting. Raise the context length and the list shortens; the calculator lets you check any combination directly. The speed column is this card: a measured run, a range scaled from this card's own Llama 2 7B benchmark, or a bandwidth ceiling. A figure that only exists for the RTX 4090 is labelled as that card.

A further 2 models load but with no headroom to spare (up to 105% of VRAM) — the Quant Hub’s GPU chips count those too, which is why its number is higher.

Measured on this card

No benchmark runs in this index were recorded on a H100 80G. Every figure on this page is calculated from the model architecture and the quant level — treat them as estimates, not measurements.

Cards with the same budget

What fits is decided by memory, so every 80GB card of this type returns the same list. These pages are not different answers — they differ in throughput, which this index does not measure per card.

• 🔵 A100 80G

Same list, different speed — play one sentence on both cards: H100 80G vs A100 80G (Qwen3 32B Instruct)

Common questions