Leaderboard Β· All comparisons Β· LynxBenchAI 26Q3 Index
Device pages: NVIDIA H200 Β· NVIDIA H100 80GB HBM3
On the LynxBenchAI 26Q3 Index, the NVIDIA H200 scores 1.11x the NVIDIA H100 80GB HBM3 overall (Training 1.14x, Inference 1.14x, Compute 0.99x). It leads on Training and Inference and trails on Compute.
| Score | Ratio | H200 | H100 80GB HBM3 |
|---|---|---|---|
| Overall (GT) | 1.11x | 1044.99 | 939.45 |
| Training | 1.14x | 811.98 | 709.35 |
| Inference | 1.14x | 1914.61 | 1678.11 |
| Compute | 0.99x | 480.83 | 487.13 |
| Model | Precision | Ratio | H200 | H100 80GB HBM3 |
|---|---|---|---|---|
| compute | ||||
| Dense MatMul | BF16 | 1.00x | 1311.34 | 1315.06 |
| Dense MatMul | FP16 | 0.99x | 1257.00 | 1264.27 |
| Dense MatMul | FP32 | 0.99x | 1018.00 | 1026.69 |
| Dense MatMul | FP64 | 0.97x | 400.40 | 414.37 |
| Sparse MatMul | FP32 | 0.97x | 156.14 | 161.05 |
| Sparse MatMul | FP64 | 0.99x | 277.15 | 280.45 |
| inference | ||||
| DistilBERT | FP16 | 1.09x | 2839.56 | 2611.72 |
| DistilBERT | FP8 | 1.08x | 1465.34 | 1362.71 |
| DistilBERT | INT8 | 1.06x | 1155.28 | 1090.29 |
| DistilGPT2 | FP16 | 1.07x | 4070.93 | 3797.65 |
| DistilGPT2 | FP8 | 1.07x | 2059.57 | 1920.23 |
| DistilGPT2 | INT8 | 1.07x | 1587.21 | 1489.31 |
| Flan-T5 Small | FP16 | 1.13x | 4434.11 | 3919.63 |
| Flan-T5 Small | FP8 | 1.15x | 1915.20 | 1658.94 |
| Flan-T5 Small | INT8 | 1.09x | 1521.28 | 1389.31 |
| GraphGPS (Peptides) | FP16 | 1.30x | 1381.98 | 1060.04 |
| GraphGPS (Peptides) | FP8 | 1.33x | 730.53 | 548.07 |
| GraphGPS (Peptides) | INT8 | 1.30x | 674.71 | 520.52 |
| MobileNetV3 | FP16 | 1.12x | 3178.18 | 2832.98 |
| MobileNetV3 | INT8 | 1.24x | 1156.30 | 931.43 |
| training | ||||
| DistilBERT | BF16 | 1.17x | 1506.93 | 1291.98 |
| DistilBERT | FP32 | 1.13x | 1677.92 | 1480.99 |
| DistilGPT2 | BF16 | 1.13x | 736.71 | 651.85 |
| DistilGPT2 | FP32 | 1.17x | 1358.73 | 1159.01 |
| Flan-T5 Small | BF16 | 1.27x | 793.25 | 622.63 |
| Flan-T5 Small | FP32 | 1.33x | 1459.48 | 1095.97 |
| GraphGPS (Peptides) | BF16 | 0.96x | 372.84 | 386.94 |
| GraphGPS (Peptides) | FP32 | 1.14x | 426.96 | 374.00 |
| MobileNetV3 | BF16 | 1.02x | 263.18 | 257.12 |
| MobileNetV3 | FP32 | 1.07x | 602.18 | 564.13 |
Each figure is the first device's overall score divided by the second's.
Measure your own machine: pip install lynxbench-ai Β· Install guide β
A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).
Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.
Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.
LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).
The Personal Edition submits your benchmark results to TechnoLynx's servers as part of participating in the public leaderboard. If that isn't acceptable for your use case, contact TechnoLynx about Press, Pro, or Enterprise licenses.
LynxBenchAI End-User License Agreement · LynxBenchAI Privacy Policy