← who's hiring

AI infrastructure & GPU engineer salaries

Median base pay across 63 live disclosed salary ranges for GPU, CUDA, inference, ML-systems and performance engineering roles — overall $180K$260K (midpoint $211K). Refreshed daily from each employer's own postings.

These figures come from the salary ranges AI-infrastructure employers publish directly in their own job postings — 78 of 178 current openings disclose a band, and 63 of those are precise enough to use (legal placeholder ranges wider than 2.3× their floor are excluded, the same rule the structured data uses). Unlike a general salary aggregator, every number here is segmented to this one niche: GPU, CUDA, inference, ML-systems and performance engineering, across the AI labs, accelerator makers and GPU-cloud providers actively hiring for it. It is a snapshot of what is open right now, not a survey of the whole market.

The clearest pattern is the gap between frontier labs and infrastructure providers: the labs disclose the highest bands in the set, while GPU-cloud and accelerator companies cluster noticeably lower. By specialty, inference and model-serving roles tend to pay above raw GPU/kernel and performance work. Read the role count (Roles) next to every figure — a median over a handful of postings is indicative, not authoritative, and the numbers shift as roles open and close.

By specialty

SpecialtyRolesMedian lowMedian highMidpoint
ML Systems & Infrastructure5$248K$311K$280K
Inference & Model Serving25$216K$275K$243K
GPU & CUDA Engineering13$170K$242K$204K
Performance & Kernel Engineering17$170K$250K$204K

By level

LevelRolesMedian lowMedian highMidpoint
Manager / Director7$228K$314K$271K
Staff / Principal18$190K$275K$232K
Senior13$165K$225K$196K

By company

CompanyRolesMedian lowMedian highMidpoint
Anthropic10$405K$485K$445K
Scale AI3$216K$270K$243K
Nebius5$170K$300K$235K
Databricks11$190K$232K$211K
Together AI6$160K$250K$205K
CoreWeave9$165K$242K$204K
MatX3$120K$275K$198K

Medians over base-salary ranges disclosed in the postings, in USD (nearly all disclosure in this set is US). Placeholder ranges ≥2.3× their floor are excluded; segments with fewer than 3 disclosed ranges are omitted as too thin to report. Recomputed daily from the live feed.

Browse the roles behind these numbers: Who's hiring · All roles · ML Systems & Infrastructure · Inference & Model Serving · GPU & CUDA Engineering · Performance & Kernel Engineering

Refreshed 2026-06-01 11:35 UTC