Engineering Manager, Inference Infrastructure

About this job

About the role Every request that hits Claude — from claude.ai, the API, our cloud partners, or internal research — depends on a set of decisions made before it ever reaches a model: where each request should be served and how much capacity each model needs right now. Getting those decisions right is crucial to satisfying throughput, reliability, and latency constraints. This group builds the control plane that makes those decisions for Anthropic's inference fleet and own the inference request path. This is a deeply technical group. The engineers here design placement and load-balancing algorithms, build quantitative models of demand, capacity, and system performance, improve latency across kernel, network, and framework boundaries, and reason carefully about how a change to the fleet…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 421 United States vacancies that list requirements, these are the skills employers ask for most often.

• Project Management36% of postings
• CAD22% of postings
• AutoCAD20% of postings
• Lean17% of postings
• MATLAB14% of postings
• Six Sigma11% of postings
• Quality Assurance10% of postings
• Revit9% of postings

Similar jobs

• Lead Infrastructure Engineer ( SDWAN)- Risk Management · JPMorgan Chase
• Director of Engineering, Platform (Runtime & Stateful Systems) · Sentry
• Staff Software Engineer, AI Platform & Infrastructure · Okta
• SVP - Data Engineering, Data Science & Analytics · AXS
• Frontend Engineer - Design Systems · Mercury
• Sr. Software Engineer, AI Platform & Infrastructure · Okta