Senior Software Engineer, Model Serving

About this job

Databricks’ Model Serving product provides enterprises with a unified, scalable, and governed platform to deploy and manage AI/ML models — from traditional ML to fine-tuned and proprietary large language models. It offers real-time, low-latency inference, governance, monitoring, and lineage. As AI adoption accelerates, Model Serving is a core pillar of the Databricks platform, enabling customers to operationalize models at scale with strong SLAs and cost efficiency. As a Senior Engineer, you’ll play a critical role in shaping both the product experience and the foundational infrastructure of Model Serving. You will design and build systems that enable high-throughput, low-latency inference across CPU and GPU workloads, influence architectural direction, and collaborate closely across…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 929 United States vacancies that list requirements, these are the skills employers ask for most often.

• Python56% of postings
• AWS39% of postings
• Java37% of postings
• CI/CD35% of postings
• Kubernetes31% of postings
• Agile/Scrum30% of postings
• React21% of postings
• SQL21% of postings

Similar jobs

• Staff+ Software Engineer, Platform Safety · Anthropic
• Senior Software Engineer, · Ripple
• Staff+ Software Engineer, VectorDB · Anthropic
• Senior Staff AI-Native Software Engineer – Agentic Systems · ServiceNow
• Manager, Software Engineering - AI Infrastructure · Figma
• Senior Software Engineer - Optimization, Remix · Via