AI infrastructure & GPU engineer salaries
Median base pay across 63 live disclosed salary ranges for GPU, CUDA, inference, ML-systems and performance engineering roles — overall $180K–$260K (midpoint $211K). Refreshed daily from each employer's own postings.
These figures come from the salary ranges AI-infrastructure employers publish directly in their own job postings — 78 of 178 current openings disclose a band, and 63 of those are precise enough to use (legal placeholder ranges wider than 2.3× their floor are excluded, the same rule the structured data uses). Unlike a general salary aggregator, every number here is segmented to this one niche: GPU, CUDA, inference, ML-systems and performance engineering, across the AI labs, accelerator makers and GPU-cloud providers actively hiring for it. It is a snapshot of what is open right now, not a survey of the whole market.
The clearest pattern is the gap between frontier labs and infrastructure providers: the labs disclose the highest bands in the set, while GPU-cloud and accelerator companies cluster noticeably lower. By specialty, inference and model-serving roles tend to pay above raw GPU/kernel and performance work. Read the role count (Roles) next to every figure — a median over a handful of postings is indicative, not authoritative, and the numbers shift as roles open and close.
By specialty
| Specialty | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| ML Systems & Infrastructure | 5 | $248K | $311K | $280K |
| Inference & Model Serving | 25 | $216K | $275K | $243K |
| GPU & CUDA Engineering | 13 | $170K | $242K | $204K |
| Performance & Kernel Engineering | 17 | $170K | $250K | $204K |
By level
| Level | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Manager / Director | 7 | $228K | $314K | $271K |
| Staff / Principal | 18 | $190K | $275K | $232K |
| Senior | 13 | $165K | $225K | $196K |
By company
| Company | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Anthropic | 10 | $405K | $485K | $445K |
| Scale AI | 3 | $216K | $270K | $243K |
| Nebius | 5 | $170K | $300K | $235K |
| Databricks | 11 | $190K | $232K | $211K |
| Together AI | 6 | $160K | $250K | $205K |
| CoreWeave | 9 | $165K | $242K | $204K |
| MatX | 3 | $120K | $275K | $198K |
Medians over base-salary ranges disclosed in the postings, in USD (nearly all disclosure in this set is US). Placeholder ranges ≥2.3× their floor are excluded; segments with fewer than 3 disclosed ranges are omitted as too thin to report. Recomputed daily from the live feed.
Browse the roles behind these numbers: Who's hiring · All roles · ML Systems & Infrastructure · Inference & Model Serving · GPU & CUDA Engineering · Performance & Kernel Engineering