Senior Software Engineer, Inference

About this job

Own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation). Who You Are: ~ 5-8 years industry experience building distributed systems or cloud services. Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance. Optimize end-to-end ML system performance by developing and tuning CUDA kernels, reducing model latency, maximizing compute and memory bandwidth utilization, and leveraging custom accelerators for high-efficiency workloads Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry).…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 929 United States vacancies that list requirements, these are the skills employers ask for most often.

• Python54% of postings
• Java36% of postings
• CI/CD36% of postings
• AWS36% of postings
• Kubernetes32% of postings
• Agile/Scrum28% of postings
• React21% of postings
• SQL20% of postings

Similar jobs

• Senior Flight Software Engineer II · Rocket Lab Corporation
• Senior Flight Software Engineer I · Rocket Lab Corporation
• Senior Software Engineer, Proactive Security - Platform · DoorDash USA
• Principal Software Engineer, Spacecraft Simulation · True Anomaly
• Sr. Project Manager, Software Product Development · Intuitive
• AI Software Engineer · Credence