Software Engineer, Inference

Luma AI · Redwood City

Don’t apply blind. See how your CV matches Software Developer first — free, in 30 seconds.

Check my CV — freeApply on jobs.ashbyhq.com ↗

You will leave NewLuxJob. We do not receive or handle applications.

Company
Luma AI
Location
Redwood City
Employment type
Full-time
Posted
July 24, 2026

About this job

You'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping expensive GPU fleets busy while meeting internal SLOs. This is large-scale inference systems work: scheduling, fleet management, deployment pipelines, and reliability across clusters and hardware providers. It fits a strong systems engineer comfortable with model serving and Kubernetes at scale. If you want pure modeling rather than the systems that run models, this is firmly the systems side. What You'll Own - Ship new model architectures by integrating them into the inference engine. - Collaborate across research, engineering, and infrastructure to optimize model efficiency and deployments.…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in United States

Based on 723 United States vacancies that list requirements, these are the skills employers ask for most often.

  • Python53% of postings
  • Java46% of postings
  • Agile/Scrum43% of postings
  • CI/CD42% of postings
  • AWS34% of postings
  • SQL27% of postings
  • Kubernetes26% of postings
  • Microservices20% of postings
Software Developer skills

Similar jobs

See if your CV fits this job

Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.

  • Instant match score for this role
  • Tailored cover letter in one click
  • Free — no credit card
Check my CV — free
Software Engineer, Inference — Luma AI | NewLuxJob