AI Benchmark Engineer | Native Language Specialist - German (Switzerland) - Remote

About this job

About The Opportunity We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity What You’ll Deliver Task Engineering: Evaluating Coding Agents.…

This is a short summary.

Want to know if you're a fit? Check your CV against this role — free, in 30 seconds.

Most-requested skills in Switzerland

Based on 74 Switzerland vacancies that list requirements, these are the skills employers ask for most often.

• Project Management28% of postings
• CAD23% of postings
• Quality Assurance19% of postings
• SAP14% of postings
• ISO 900112% of postings
• Lean8% of postings
• SolidWorks5% of postings
• MATLAB5% of postings

Similar jobs

• Engineering Manager - Cloud Platform & Operations · Sonarsource
• Senior Security Engineer, Software · Scopely
• Talent Pool - Data & AI Engineer - DWH Transformation · Callista Group AG
• Talent Pool - Technischer IAM Spezialist / IAM Engineer 80-100% · Callista Group AG
• Data Engineer / Platform Engineer mit Expertise in Databricks (m/w/d) | Join our Talent Pool - Switzerland · Callista Group AG
• Power Electronics R&D Engineer · Secheron S Dot A