Leaderboard Β· All comparisons Β· LynxBenchAI 26Q3 Index

NVIDIA RTX 2000 Ada Generation Laptop GPU vs Intel Graphics [0x7d55] (Intel Core Ultra 7 165H) for AI

Device pages: NVIDIA RTX 2000 Ada Generation Laptop GPU Β· Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)

On the LynxBenchAI 26Q3 Index, the NVIDIA RTX 2000 Ada Generation Laptop GPU scores 4.73x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H) overall (Training 4.96x, Inference 6.44x, Compute 2.91x).

Scores on the LynxBenchAI 26Q3 Index

Ratio = the RTX 2000 Ada Generation Laptop GPU's score divided by the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)'s
ScoreRatioRTX 2000 Ada Generation Laptop GPUIntel Graphics [0x7d55] (Intel Core Ultra 7 165H)
Overall (GT)4.73x74.7915.82
Training4.96x60.7112.24
Inference6.44x111.7617.36
Compute2.91x63.1421.68
  • Runs on the RTX 2000 Ada Generation Laptop GPU only: FP8 inference.

When to Choose Which

  • Choose the RTX 2000 Ada Generation Laptop GPU for training (4.96x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)).
  • Choose the RTX 2000 Ada Generation Laptop GPU for inference (6.44x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)).
  • Choose the RTX 2000 Ada Generation Laptop GPU for raw compute (2.91x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)).

From the LynxBenchAI 26Q3 Index category scores, which are not raw throughput; a lead under 10% counts as level.

Per Model and Precision

LynxBenchAI score per model and precision; ratio = RTX 2000 Ada Generation Laptop GPU / Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)
ModelPrecisionRatioRTX 2000 Ada Generation Laptop GPUIntel Graphics [0x7d55] (Intel Core Ultra 7 165H)
compute
Dense MatMulBF1611.57x51.264.43
Dense MatMulFP167.56x50.036.61
Dense MatMulFP323.57x44.8212.55
Dense MatMulFP641.33x1.341.01
Sparse MatMulFP320.95x110.74116.25
Sparse MatMulFP6410.92x93.258.54
inference
DistilBERTFP165.64x197.5035.01
DistilBERTFP8496.42x98.620.20
DistilBERTINT84.74x102.5721.65
DistilGPT2FP163.94x159.2140.38
DistilGPT2FP8306.95x84.740.28
DistilGPT2INT83.96x86.2121.76
Flan-T5 SmallFP165.05x209.7341.49
Flan-T5 SmallFP8n/a126.12not run
Flan-T5 SmallINT83.70x103.2127.89
GraphGPS (Peptides)FP164.22x64.4715.26
GraphGPS (Peptides)FP8n/a30.56not run
GraphGPS (Peptides)INT831.88x33.141.04
MobileNetV3FP165.98x263.5544.10
MobileNetV3INT84.97x64.8513.06
training
DistilBERTBF165.65x76.3413.52
DistilBERTFP323.31x91.8927.75
DistilGPT2BF165.10x44.788.78
DistilGPT2FP323.21x72.6222.61
Flan-T5 SmallBF164.30x47.0810.95
Flan-T5 SmallFP323.93x85.3521.71
GraphGPS (Peptides)BF1612.69x38.213.01
GraphGPS (Peptides)FP323.97x34.048.58
MobileNetV3BF165.88x52.208.88
MobileNetV3FP3210.11x80.928.00

Related Comparisons

Each figure is the first device's overall score divided by the second's.

Measure your own machine: pip install lynxbench-ai Β· Install guide β†’

How to Read These Results

A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).

Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.

LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).

Questions

Is the NVIDIA RTX 2000 Ada Generation Laptop GPU faster than the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H) for AI?
On the LynxBenchAI 26Q3 Index, the NVIDIA RTX 2000 Ada Generation Laptop GPU scores 4.73x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H) overall (Training 4.96x, Inference 6.44x, Compute 2.91x).
Should I choose the NVIDIA RTX 2000 Ada Generation Laptop GPU or the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)?
Choose the RTX 2000 Ada Generation Laptop GPU for training (4.96x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)). Choose the RTX 2000 Ada Generation Laptop GPU for inference (6.44x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)). Choose the RTX 2000 Ada Generation Laptop GPU for raw compute (2.91x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)). These follow the LynxBenchAI 26Q3 Index category scores, which are not raw throughput.
Where is the difference between the NVIDIA RTX 2000 Ada Generation Laptop GPU and the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H) largest?
On the LynxBenchAI 26Q3 Index, the ratio is highest on DistilBERT at FP8 (Inference), where the NVIDIA RTX 2000 Ada Generation Laptop GPU scores 496.42x the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H), and lowest on Sparse MatMul at FP32 (Compute), at 0.95x.
Which precisions run on only one of the NVIDIA RTX 2000 Ada Generation Laptop GPU and the Intel Graphics [0x7d55] (Intel Core Ultra 7 165H)?
On the LynxBenchAI 26Q3 Index, only the NVIDIA RTX 2000 Ada Generation Laptop GPU runs FP8 inference; a precision a device cannot execute scores zero.
What does this result tell me about my own PyTorch model?
Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

The Personal Edition submits your benchmark results to TechnoLynx's servers as part of participating in the public leaderboard. If that isn't acceptable for your use case, contact TechnoLynx about Press, Pro, or Enterprise licenses.

Get Started