Forward Deployed Engineer - Assistant Vice President

About this job

The Applications Development Senior Programmer Analyst — Forward Deployed Engineer (C12) is an intermediate-level software engineering position responsible for constructing automated evaluation harnesses, curating regression testbeds, optimizing prompts and output schemas, and automating testing pipelines within embedded LOB delivery pods. The overall objective of this role is to ensure the reliability, accuracy, and safety of production AI agents by building rigorous evaluation suites in Agentflow Studio and driving automated CI/CD test execution. Responsibilities: Conducts tasks related to the construction, calibration, and execution of automated evaluation test suites using Agentflow Studio, measuring agent task completion, tool call correctness, latency, and hallucination metrics.…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 430 United States vacancies that list requirements, these are the skills employers ask for most often.

• Project Management37% of postings
• CAD22% of postings
• AutoCAD20% of postings
• Lean17% of postings
• MATLAB14% of postings
• Six Sigma12% of postings
• SolidWorks10% of postings
• Revit10% of postings

Similar jobs

• Staff iOS Engineer, Trading Tools · Robinhood
• Helpdesk Automation Engineer · SeatGeek
• Staff+ Software Engineer, Platform Safety · Anthropic
• Staff Software Engineer - Watchdog Anomaly Detection · Datadog
• PS, Solution Architect /Forward Deployment Engineer ( Armis/ Veza) · ServiceNow
• Director, Analytics Engineering · Oscar Health