Leaderboard Β· All comparisons Β· LynxBenchAI 26Q3 Index

AMD Radeon RX 9060 XT vs NVIDIA RTX 2000 Ada Generation Laptop GPU for AI

Device pages: AMD Radeon RX 9060 XT Β· NVIDIA RTX 2000 Ada Generation Laptop GPU

On the LynxBenchAI 26Q3 Index, the AMD Radeon RX 9060 XT scores 1.02x the NVIDIA RTX 2000 Ada Generation Laptop GPU overall (Training 0.61x, Inference 1.10x, Compute 1.79x). It leads on Inference and Compute and trails on Training. The two runs used different platforms (native Linux and WSL).

Scores on the LynxBenchAI 26Q3 Index

Ratio = the Radeon RX 9060 XT's score divided by the RTX 2000 Ada Generation Laptop GPU's
ScoreRatioRadeon RX 9060 XTRTX 2000 Ada Generation Laptop GPU
Overall (GT)1.02x76.2674.79
Training0.61x37.1960.71
Inference1.10x122.69111.76
Compute1.79x112.7263.14

When to Choose Which

  • Choose the RTX 2000 Ada Generation Laptop GPU for training (1.63x the Radeon RX 9060 XT).
  • Level on inference: the two are within 10% (1.10x).
  • Choose the Radeon RX 9060 XT for raw compute (1.79x the RTX 2000 Ada Generation Laptop GPU).

From the LynxBenchAI 26Q3 Index category scores, which are not raw throughput; a lead under 10% counts as level.

Per Model and Precision

LynxBenchAI score per model and precision; ratio = Radeon RX 9060 XT / RTX 2000 Ada Generation Laptop GPU
ModelPrecisionRatioRadeon RX 9060 XTRTX 2000 Ada Generation Laptop GPU
compute
Dense MatMulBF162.36x121.2051.26
Dense MatMulFP162.42x120.9450.03
Dense MatMulFP320.17x7.4244.82
Dense MatMulFP642.07x2.781.34
Sparse MatMulFP321.90x210.85110.74
Sparse MatMulFP641.91x178.3493.25
inference
DistilBERTFP161.22x241.27197.50
DistilBERTFP81.34x132.0898.62
DistilBERTINT81.27x129.82102.57
DistilGPT2FP161.78x283.55159.21
DistilGPT2FP81.81x153.0884.74
DistilGPT2INT81.73x149.1386.21
Flan-T5 SmallFP162.07x434.09209.73
Flan-T5 SmallFP81.58x199.10126.12
Flan-T5 SmallINT81.61x166.04103.21
GraphGPS (Peptides)FP161.13x72.8264.47
GraphGPS (Peptides)FP81.17x35.8630.56
GraphGPS (Peptides)INT81.07x35.5833.14
MobileNetV3FP160.32x83.58263.55
MobileNetV3INT80.50x32.3864.85
training
DistilBERTBF161.25x95.4776.34
DistilBERTFP320.17x15.3291.89
DistilGPT2BF161.61x72.1244.78
DistilGPT2FP320.19x13.5172.62
Flan-T5 SmallBF161.61x76.0047.08
Flan-T5 SmallFP320.29x24.7885.35
GraphGPS (Peptides)BF160.44x16.8738.21
GraphGPS (Peptides)FP320.50x16.8934.04
MobileNetV3BF160.53x27.5052.20
MobileNetV3FP320.49x39.5480.92

Related Comparisons

Each figure is the first device's overall score divided by the second's.

Measure your own machine: pip install lynxbench-ai Β· Install guide β†’

How to Read These Results

A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).

Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.

LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).

Questions

Is the AMD Radeon RX 9060 XT faster than the NVIDIA RTX 2000 Ada Generation Laptop GPU for AI?
On the LynxBenchAI 26Q3 Index, the AMD Radeon RX 9060 XT scores 1.02x the NVIDIA RTX 2000 Ada Generation Laptop GPU overall (Training 0.61x, Inference 1.10x, Compute 1.79x). It leads on Inference and Compute and trails on Training. The two runs used different platforms (native Linux and WSL).
Should I choose the AMD Radeon RX 9060 XT or the NVIDIA RTX 2000 Ada Generation Laptop GPU?
Choose the RTX 2000 Ada Generation Laptop GPU for training (1.63x the Radeon RX 9060 XT). Level on inference: the two are within 10% (1.10x). Choose the Radeon RX 9060 XT for raw compute (1.79x the RTX 2000 Ada Generation Laptop GPU). These follow the LynxBenchAI 26Q3 Index category scores, which are not raw throughput.
Where is the difference between the AMD Radeon RX 9060 XT and the NVIDIA RTX 2000 Ada Generation Laptop GPU largest?
On the LynxBenchAI 26Q3 Index, the ratio is highest on Dense MatMul at FP16 (Compute), where the AMD Radeon RX 9060 XT scores 2.42x the NVIDIA RTX 2000 Ada Generation Laptop GPU, and lowest on Dense MatMul at FP32 (Compute), at 0.17x.
What does this result tell me about my own PyTorch model?
Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

The Personal Edition submits your benchmark results to TechnoLynx's servers as part of participating in the public leaderboard. If that isn't acceptable for your use case, contact TechnoLynx about Press, Pro, or Enterprise licenses.

Get Started