Software Engineer, Spark Platform

About this job

About the Role As a Software Engineer on Spark Platform, you will execute across the surfaces of our in-house Spark deployment that serves the entire company. The work spans Spark runtime upgrades and performance, multi-tenant scheduling and executor bin-packing on Kubernetes, cluster lifecycle automation, and the observability and incident automation that keep the platform sustainable. You will move between layers as the work demands — picking up the next high-leverage problem regardless of where it sits — and partner closely with the rest of the team and with platform consumers across the company. You must be located in San Francisco, Sunnyvale, Seattle, or New York City for this hybrid position. You will report into the Engineering Manager on our Spark Platform team.…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in the United States

Based on 929 United States vacancies that list requirements, these are the skills employers ask for most often.

• Python54% of postings
• Java36% of postings
• CI/CD36% of postings
• AWS36% of postings
• Kubernetes32% of postings
• Agile/Scrum28% of postings
• React21% of postings
• SQL20% of postings

Similar jobs

• Staff Software Engineer, Link - Consumer Identity · Stripe
• Senior Software Engineer (Ruby/Rails), MVR · Checkr
• 2027 Hearst AI Newsroom Developer Fellowship Program · Hearst
• Staff Software Engineer, AI Platform & Infrastructure · Okta
• Sr. Software Engineer, AI Platform & Infrastructure · Okta
• Senior Software Engineer - Cards · Mercury