AI infrastructure & GPU engineer salaries
Median base pay across 55 live disclosed salary ranges for GPU, CUDA, inference, ML-systems and performance engineering roles — overall $190K–$260K (midpoint $229K). Refreshed daily from each employer's own postings.
These figures come from the salary ranges AI-infrastructure employers publish directly in their own job postings — 73 of 130 current openings disclose a band, and 55 of those are precise enough to use (legal placeholder ranges wider than 2.3× their floor are excluded, the same rule the structured data uses). Unlike a general salary aggregator, every number here is segmented to this one niche: GPU, CUDA, inference, ML-systems and performance engineering, across the AI labs, accelerator makers and GPU-cloud providers actively hiring for it. It is a snapshot of what is open right now, not a survey of the whole market.
The clearest pattern is the gap between frontier labs and infrastructure providers: the labs disclose the highest bands in the set, while GPU-cloud and accelerator companies cluster noticeably lower. By specialty, inference and model-serving roles tend to pay above raw GPU/kernel and performance work. Read the role count (Roles) next to every figure — a median over a handful of postings is indicative, not authoritative, and the numbers shift as roles open and close.
By specialty
| Specialty | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| ML Systems & Infrastructure | 6 | $300K | $350K | $325K |
| Inference & Model Serving | 24 | $192K | $265K | $229K |
| Performance & Kernel Engineering | 20 | $182K | $255K | $218K |
| GPU & CUDA Engineering | 9 | $180K | $242K | $212K |
By level
| Level | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Manager / Director | 5 | $245K | $380K | $310K |
| Staff / Principal | 22 | $215K | $280K | $238K |
| Senior | 15 | $179K | $242K | $205K |
By company
| Company | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Anthropic | 9 | $350K | $485K | $425K |
| Crusoe | 6 | $215K | $260K | $238K |
| SambaNova | 7 | $200K | $275K | $238K |
| Nebius | 6 | $180K | $262K | $229K |
| Databricks | 6 | $190K | $260K | $226K |
| CoreWeave | 8 | $182K | $242K | $212K |
| Together AI | 6 | $160K | $250K | $205K |
Medians over base-salary ranges disclosed in the postings, in USD (nearly all disclosure in this set is US). Placeholder ranges ≥2.3× their floor are excluded; segments with fewer than 3 disclosed ranges are omitted as too thin to report. Recomputed daily from the live feed.
Browse the roles behind these numbers: Who's hiring · All roles · ML Systems & Infrastructure · Inference & Model Serving · Performance & Kernel Engineering · GPU & CUDA Engineering