Staff Software Engineer, Inference

About the role

Our Inference team builds and maintains the critical systems that serve Claude to millions of users worldwide. The team delivers the industry’s largest compute‑agnostic inference deployments, handling intelligent request routing, fleet‑wide orchestration, and support for diverse AI accelerators across multiple cloud platforms.

Key responsibilities

• Design, build, and operate distributed systems that deliver Claude at scale.
• Develop resilient, real‑time adaptive infrastructure for production workloads.
• Create intelligent request routing, load‑balancing, and traffic‑management across thousands of accelerators.
• Maximize compute efficiency through autoscaling and orchestration of production, research, and experimental jobs.
• Build and maintain production‑grade deployment pipelines for new model releases.
• Provide high‑performance inference infrastructure enabling next‑generation model research.
• Integrate emerging AI accelerator platforms and support new model architectures.

Required profile

• Proficiency in Python or Rust.
• Experience building and operating distributed systems in production.
• Working knowledge of containerized infrastructure (e.g., Kubernetes) and at least one major cloud platform (AWS, GCP, or Azure).
• Results‑oriented mindset with flexibility and impact focus.
• Willingness to take on tasks beyond the core description and learn about ML systems.
• Commitment to the societal impact of AI work.

Required skills

• Python
• Rust
• Kubernetes
• AWS
• GCP
• Azure
• Containerized infrastructure
• AI accelerator platforms (GPUs, TPUs)

What we offer

• Annual salary between £325,000 and £390,000.
• Competitive benefits including equity donation matching, generous vacation and parental leave, flexible working hours, and a collaborative office environment.
• Visa sponsorship where possible.