Software Engineer, Inference
Sierra · San Francisco
Don’t apply blind. See how your CV matches Software Developer first — free, in 30 seconds.
You will leave NewLuxJob. We do not receive or handle applications.
- Company
- Sierra
- Location
- San Francisco
- Employment type
- Full-time
- Posted
- October 5, 2026
About this job
ABOUT THE ROLE Sierra’s AI agents depend on foundation models to reason and act in real time. The Inference team builds the systems that make those models fast, reliable, and efficient at scale. As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers. You’ll work on the systems responsible for serving and routing inference, managing capacity and quota, and optimizing for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—we’re looking for engineers who love complex systems problems and are excited to apply that expertise to one of the fastest-moving areas of AI infrastructure.…
This is a short summary.
Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.
Most-requested skills in the United States
Based on 937 United States vacancies that list requirements, these are the skills employers ask for most often.
- Python56% of postings
- AWS39% of postings
- Java38% of postings
- CI/CD33% of postings
- Kubernetes32% of postings
- Agile/Scrum28% of postings
- React22% of postings
- SQL20% of postings
Similar jobs
See if your CV fits this job
Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.
- Instant match score for this role
- Tailored cover letter in one click
- Free — no credit card