Engineering Manager, AI Evaluation
Handshake · San Francisco
Don’t apply blind. See how your CV matches Engineer first — free, in 30 seconds.
You will leave NewLuxJob. We do not receive or handle applications.
- Company
- Handshake
- Location
- San Francisco
- Employment type
- Full-time
- Posted
- July 14, 2026
About this job
ABOUT THE ROLE We're hiring an Engineering Manager to own our Quality team. The team builds the systems that define, select, and enforce quality standards across the data and evaluations we deliver to leading AI labs. This team works on infrastructure that evaluates complex outputs submitted by fellows, such as coding tasks designed to challenge advanced AI models. These quality checks run throughout the production process: providing real-time feedback to fellows, supporting internal operators, and validating outputs before they reach customers. Location: San Francisco, CA. This is an in-office role, 5 days/week (no remote/hybrid) YOU HAVE Must-Haves: - 7+ years of engineering experience, including 3+ years managing engineering teams of 8 or more and experience manager managers.…
This is a short summary.
Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.
Most-requested skills in United States
Based on 371 United States vacancies that list requirements, these are the skills employers ask for most often.
- Project Management35% of postings
- CAD24% of postings
- AutoCAD21% of postings
- MATLAB18% of postings
- Revit12% of postings
- Lean11% of postings
- SolidWorks11% of postings
- FEM/FEA7% of postings
Similar jobs
- Senior Fullstack Engineer, AI Observability & Evals Platform · LangChain
- Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith) · LangChain
- Senior Product Analytics Engineer - Ads · Faire
- Staff Software Engineer, Search · Anthropic
- Senior Engineering Manager, Capacity Engineering · Anthropic
- Senior Electrical Engineer, Power Electronics · Nimble Robotics
See if your CV fits this job
Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.
- Instant match score for this role
- Tailored cover letter in one click
- Free — no credit card