Staff Software Engineer – AI (LLM)

About the role

StepStone Group is looking for a Staff Software Engineer (AI) to design, build and evolve production‑grade, agentic AI systems. This individual‑contributor leadership position focuses on integrating Large Language Models into secure, scalable and observable architectures that power our global job marketplace.

Key responsibilities

• Design, architect and deliver LLM‑powered systems on AWS, ensuring production readiness, scalability, reliability and security.
• Provide technical leadership to transition AI solutions from experimentation to robust, observable, maintainable products.
• Collaborate with product, engineering, ML and data teams to align technical decisions with user needs and business priorities.
• Define and drive engineering standards, reusable patterns, tools and best practices for responsible AI systems.
• Lead large‑scale implementation and deployment, overseeing testing, monitoring, evaluation, guardrails and operational support while mentoring engineers.

Required profile

• Strong staff‑level software engineering background with expertise in Python and at least one of Java, TypeScript or .NET.
• Proven track record delivering production‑grade systems.
• Experience designing, building and operating distributed systems on AWS or similar cloud platforms, including secure development, data protection, compliance and enterprise architecture principles.
• Hands‑on experience integrating LLMs into production, including use of APIs.

Required skills

• Python
• Java
• TypeScript
• .NET
• AWS
• Large Language Model integration
• API usage