Cyber Evaluations Engineer

About this job

About the role We're hiring Cyber Evaluations Engineers to build and run the evaluations that measure cyber-relevant capabilities and safeguard robustness in our models. You'll design new evals, run per-release robustness testing, and dig into data on jailbreaks and prompt bypasses to understand where our safeguards hold up and where they don't. You'll also design many of the probes that detect cyber abuse in production and help shape the overall detection architecture alongside the policy team. Key responsibilities Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models Execute per-release safeguard-robustness testing ahead of major model launches Analyze evaluation results and communicate findings clearly to the team and to stakeholders…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in United States

Based on 82 United States vacancies that list requirements, these are the skills employers ask for most often.

• Project Management49% of postings
• CAD26% of postings
• Quality Assurance9% of postings
• PLC7% of postings
• Lean7% of postings
• FEM/FEA7% of postings
• SolidWorks6% of postings
• MATLAB5% of postings

Similar jobs

• Senior Machine Learning Engineer, Predictive Planner, Systems Arch · Waymo
• Senior Software Engineer, Edge Security · Fastly
• Senior Security Engineer - Detection & Response · Klaviyo
• Engineering Manager, Growth · Sentry
• Lead Infrastructure Engineer-Network Engineer · JPMorgan Chase
• Performance Engineer, Inference Engine · Anthropic