Datacenter Infrastructure Specialist

About the role

Runpod is building a global, high‑density GPU fleet to support AI workloads. As a Datacenter Infrastructure Specialist you will be the operational linchpin, bridging hardware partners and internal engineering teams to ensure reliability and performance at scale.

Key responsibilities

• Validate and benchmark new hardware to meet Runpod’s specifications for distributed AI/ML workloads.
• Monitor fleet health, audit downtime and enforce SLA compliance.
• Leverage AI agents and LLMs to automate network triage and generate dynamic runbooks.
• Coordinate incident communications, providing clear updates and actionable resolutions.
• Support infrastructure partners with technical guidance and growth initiatives.

Required profile

• 3–5 years of experience in infrastructure operations, systems reliability, or datacenter engineering.
• Strong proficiency in datacenter networking and performance troubleshooting; exposure to RDMA, InfiniBand or RoCE preferred.
• Hands‑on experience with the NVIDIA software stack and multi‑node GPU performance tuning.
• Solid Linux system administration skills and familiarity with containerization (Docker).
• Effective written and verbal communication for both technical partners and leadership.
• Willingness to participate in on‑call rotation as the fleet scales.
• Experience in fast‑paced startup environments and building operational workflows.

Required skills

• RDMA, InfiniBand, RoCE
• NVIDIA driver installation and performance utilities
• Linux administration
• Docker
• Grafana, Prometheus, Datadog
• Python, Go, Bash scripting

What we offer

• Competitive annual base salary ranging from €105,324 to €140,432.
• Equity participation through stock options.
• Comprehensive medical, dental and vision coverage.
• Flexible paid time off and remote‑first work environment.
• $1,200 home‑office and equipment stipend.
• Inclusive culture with emphasis on learning and ownership.