AI infrastructure & GPU engineer salaries
Median base pay across 45 live disclosed salary ranges for GPU, CUDA, inference, ML-systems and performance engineering roles — overall $200K–$300K (midpoint $245K). Refreshed daily from each employer's own postings.
These figures come from the salary ranges AI-infrastructure employers publish directly in their own job postings — 68 of 134 current openings disclose a band, and 45 of those are precise enough to use (legal placeholder ranges wider than 2.3× their floor are excluded, the same rule the structured data uses). Unlike a general salary aggregator, every number here is segmented to this one niche: GPU, CUDA, inference, ML-systems and performance engineering, across the AI labs, accelerator makers and GPU-cloud providers actively hiring for it. It is a snapshot of what is open right now, not a survey of the whole market.
The clearest pattern is the gap between frontier labs and infrastructure providers: the labs disclose the highest bands in the set, while GPU-cloud and accelerator companies cluster noticeably lower. By specialty, inference and model-serving roles tend to pay above raw GPU/kernel and performance work. Read the role count (Roles) next to every figure — a median over a handful of postings is indicative, not authoritative, and the numbers shift as roles open and close.
By specialty
| Specialty | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| ML Systems & Infrastructure | 4 | $300K | $350K | $325K |
| Inference & Model Serving | 22 | $245K | $300K | $275K |
| Performance & Kernel Engineering | 12 | $190K | $260K | $235K |
| GPU & CUDA Engineering | 7 | $180K | $242K | $212K |
By level
| Level | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Manager / Director | 5 | $250K | $325K | $285K |
| Staff / Principal | 19 | $250K | $300K | $275K |
| Senior | 10 | $180K | $225K | $202K |
By company
| Company | Roles | Median low | Median high | Midpoint |
|---|---|---|---|---|
| Anthropic | 12 | $350K | $485K | $425K |
| Crusoe | 6 | $250K | $300K | $275K |
| Together AI | 5 | $200K | $300K | $250K |
| SambaNova | 4 | $210K | $280K | $245K |
| CoreWeave | 7 | $182K | $242K | $212K |
| Databricks | 3 | $190K | $232K | $211K |
| Nebius | 3 | $179K | $224K | $202K |
Medians over base-salary ranges disclosed in the postings, in USD (nearly all disclosure in this set is US). Placeholder ranges ≥2.3× their floor are excluded; segments with fewer than 3 disclosed ranges are omitted as too thin to report. Recomputed daily from the live feed.
Browse the roles behind these numbers: Who's hiring · All roles · ML Systems & Infrastructure · Inference & Model Serving · Performance & Kernel Engineering · GPU & CUDA Engineering