LynxBenchAI Β· Leaderboard

AI Hardware Comparisons

Two devices side by side, measured the same way: the same PyTorch models on the stock, publicly released stack, each at its own saturation point. Every comparison shows the overall ratio, the Training, Inference and Compute ratios, and every model and precision underneath.

Headline Findings

  • Same chip, different form factor 0.65x The NVIDIA H100 PCIe scores 0.65x the NVIDIA H100 80GB HBM3 overall on the LynxBenchAI 26Q3 Index. See the comparison
  • Cross-vendor, stock PyTorch 1.03x The AMD Instinct MI300X scores 1.03x the NVIDIA H100 80GB HBM3 on Training on the LynxBenchAI 26Q3 Index. See the comparison
  • Consumer vs data-centre 0.81x The NVIDIA GeForce RTX 4090 scores 0.81x the NVIDIA A100-SXM4-80GB on Training on the LynxBenchAI 26Q3 Index. See the comparison
  • WSL2 vs native Linux 0.91x The NVIDIA GeForce RTX 5090 (WSL) scores 0.91x the NVIDIA GeForce RTX 5090 overall on the LynxBenchAI 26Q3 Index. See the comparison
  • Generation step, data centre 2.13x The NVIDIA H100 80GB HBM3 scores 2.13x the NVIDIA A100-SXM4-80GB overall on the LynxBenchAI 26Q3 Index. See the comparison
  • Generation step, consumer 1.33x The NVIDIA GeForce RTX 5090 scores 1.33x the NVIDIA GeForce RTX 4090 overall on the LynxBenchAI 26Q3 Index. See the comparison
  • Laptop GPU on the same scale 0.17x The NVIDIA RTX 2000 Ada Generation Laptop GPU scores 0.17x the NVIDIA GeForce RTX 4090 overall on the LynxBenchAI 26Q3 Index. See the comparison

Data-Centre Generations

Each figure is the first device's overall score divided by the second's.

AMD vs NVIDIA on Stock PyTorch

Each figure is the first device's overall score divided by the second's.

Consumer vs Data-Centre

Each figure is the first device's overall score divided by the second's.

Consumer GPUs

Each figure is the first device's overall score divided by the second's.

Same Chip, Different Setup

Each figure is the first device's overall score divided by the second's.

How to Read These Results

A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).

Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.

LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).