← who's hiring

AI infrastructure & GPU engineer salaries

Median base pay across 58 live disclosed salary ranges for GPU, CUDA, inference, ML-systems and performance engineering roles — overall $180K$260K (midpoint $211K). Refreshed daily from each employer's own postings.

These figures come from the salary ranges AI-infrastructure employers publish directly in their own job postings — 75 of 142 current openings disclose a band, and 58 of those are precise enough to use (legal placeholder ranges wider than 2.3× their floor are excluded, the same rule the structured data uses). Unlike a general salary aggregator, every number here is segmented to this one niche: GPU, CUDA, inference, ML-systems and performance engineering, across the AI labs, accelerator makers and GPU-cloud providers actively hiring for it. It is a snapshot of what is open right now, not a survey of the whole market.

The clearest pattern is the gap between frontier labs and infrastructure providers: the labs disclose the highest bands in the set, while GPU-cloud and accelerator companies cluster noticeably lower. By specialty, inference and model-serving roles tend to pay above raw GPU/kernel and performance work. Read the role count (Roles) next to every figure — a median over a handful of postings is indicative, not authoritative, and the numbers shift as roles open and close.

By specialty

SpecialtyRolesMedian lowMedian highMidpoint
ML Systems & Infrastructure6$248K$311K$280K
Inference & Model Serving22$190K$260K$226K
GPU & CUDA Engineering11$170K$242K$204K
Performance & Kernel Engineering19$165K$242K$198K

By level

LevelRolesMedian lowMedian highMidpoint
Staff / Principal19$210K$280K$238K
Senior12$165K$225K$196K

By company

CompanyRolesMedian lowMedian highMidpoint
Anthropic9$320K$485K$403K
SambaNova4$200K$275K$238K
Nebius3$170K$300K$235K
Scale AI3$189K$237K$213K
Databricks7$190K$232K$211K
Together AI7$160K$250K$205K
CoreWeave9$165K$242K$204K
MatX5$120K$275K$198K

Medians over base-salary ranges disclosed in the postings, in USD (nearly all disclosure in this set is US). Placeholder ranges ≥2.3× their floor are excluded; segments with fewer than 3 disclosed ranges are omitted as too thin to report. Recomputed daily from the live feed.

Browse the roles behind these numbers: Who's hiring · All roles · ML Systems & Infrastructure · Inference & Model Serving · GPU & CUDA Engineering · Performance & Kernel Engineering

Refreshed 2026-07-20 08:58 UTC