Senior Software Engineer, AI Evals

Sentry · San Francisco, California

Don’t apply blind. See how your CV matches Software Developer first — free, in 30 seconds.

You will leave NewLuxJob. We do not receive or handle applications.

Company
Sentry
Location
San Francisco, California
Employment type
Full-time
Salary
$155,000 to $400,000
Posted
January 28, 2026

About this job

ABOUT SENTRY Software runs the world and the pace is faster than ever. Sentry helps developers fix errors and performance issues before users notice, so teams can spend less time firefighting and more time building. Trusted by 200,000+ organizations, Sentry is today’s application monitoring standard and our team is building its AI-native future. ABOUT THE ROLE As a Senior Software Engineer on Sentry’s AI/ML team, you’ll be responsible for building the evaluation infrastructure that measures the accuracy, reliability, and real-world performance of our AI systems. This role is critical to ensuring that our debugging agents and AI-powered features behave correctly, safely, and predictably as they scale.

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in United States

Based on 698 United States vacancies that list requirements, these are the skills employers ask for most often.

  • Docker33% of postings
  • Python31% of postings
  • Java31% of postings
  • AWS27% of postings
  • Kubernetes24% of postings
  • Azure23% of postings
  • CI/CD21% of postings
  • .NET16% of postings
Software Developer skills

Similar jobs

See if your CV fits this job

Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.

  • Instant match score for this role
  • Tailored cover letter in one click
  • Free — no credit card
Check my CV — free
Senior Software Engineer, AI Evals — Sentry | NewLuxJob