Software Engineer, Inference AI/ML

CoreWeave · Sunnyvale, CA / Bellevue

Don’t apply blind. See how your CV matches Software Developer first — free, in 30 seconds.

You will leave NewLuxJob. We do not receive or handle applications.

Company
CoreWeave
Location
Sunnyvale, CA / Bellevue
Salary
$92,000 to $135,000
Posted
October 24, 2025

About this job

Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers. About the role: Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve). Write tests, code comments, and short design docs; participate in code reviews. Add basic metrics and dashboards; assist with alarms and runbooks. Follow on-call runbooks and learn incident response in a guided rotation. Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance.…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 929 United States vacancies that list requirements, these are the skills employers ask for most often.

  • Python54% of postings
  • Java36% of postings
  • CI/CD36% of postings
  • AWS36% of postings
  • Kubernetes32% of postings
  • Agile/Scrum28% of postings
  • React21% of postings
  • SQL20% of postings
Software Developer skills

Similar jobs

See if your CV fits this job

Paste your CV for an instant match score against this role — and get a tailored cover letter in one click.

  • Instant match score for this role
  • Tailored cover letter in one click
  • Free — no credit card
Check my CV — free