Engineering Manager, Inference Infrastructure

Anthropic · San Francisco, CA | New York City, NY | Seattle

Don’t apply blind. See how your CV matches Engineer first — free, in 30 seconds.

Check my CV — freeApply on job-boards.greenhouse.io ↗

You will leave NewLuxJob. We do not receive or handle applications.

Company
Anthropic
Location
San Francisco, CA | New York City, NY | Seattle
Salary
$405,000 — $625,000
Posted
September 1, 2026

About this job

About the role Every request that hits Claude — from claude.ai, the API, our cloud partners, or internal research — depends on a set of decisions made before it ever reaches a model: where each request should be served and how much capacity each model needs right now. Getting those decisions right is crucial to satisfying throughput, reliability, and latency constraints. This group builds the control plane that makes those decisions for Anthropic's inference fleet and own the inference request path. This is a deeply technical group. The engineers here design placement and load-balancing algorithms, build quantitative models of demand, capacity, and system performance, improve latency across kernel, network, and framework boundaries, and reason carefully about how a change to the fleet…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in United States

Based on 82 United States vacancies that list requirements, these are the skills employers ask for most often.

  • Project Management49% of postings
  • CAD26% of postings
  • Quality Assurance9% of postings
  • PLC7% of postings
  • Lean7% of postings
  • FEM/FEA7% of postings
  • SolidWorks6% of postings
  • MATLAB5% of postings
Engineer skills

Similar jobs

See if your CV fits this job

Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.

  • Instant match score for this role
  • Tailored cover letter in one click
  • Free — no credit card
Check my CV — free
Engineering Manager, Inference Infrastructure — Anthropic | NewLuxJob