NVIDIA is looking for an outstanding AI DevOps Engineering Manager to lead and expand our next-gen inference operations infrastructure. Join us in transforming AI inference delivery, supporting NVIDIA's innovative products like Dynamo, Triton, NIXL, and our quickly growing range of AI inference solutions. This role is essential for our GitHub First initiative, enabling public CI/CD infrastructure with GPU and Kubernetes capabilities to deliver high-throughput, low-latency inferencing solutions in distributed environments. Lead a team ensuring our AI products achieve outstanding performance and reliability worldwide.What you'll be doing:Supervise a team of DevOps engineers with expertise in AI inference infrastructure, test automation (SDET), and Infrastructure as Code (IaC)Architect and implement scalable test automation strategies for AI inference workloads, including performance benchmarking and automated quality gatesLead the maintenance of our GitHub First public CI infrastructure, focusing on single/multi-GPU testing, Kubernetes multi-node GPU testing, and CSP validationDrive Infrastructure as Code efforts by employing Terraform, Ansible, and Kubernetes to support scaling across multiple clouds and lead GPU clusters effectively.Attain operational proficiency encompassing 24x7 on-call rotations, SRE methodologies, automated monitoring, and self-repairing systems to guarantee uptime exceeding 99.9%Lead release coordination, cost optimization, and management of multi-cloud deploymentsWhat we need to see:Bachelor's/Master's degree in Computer Science, Engineering, or equivalent experience4+ years leading DevOps/SRE organizations with direct SDET leadership experience8+ years hands-on experience in software development, test automation, or infrastructure engineering with AI/ML or GPU-intensive workloadsProficiency in Infrastructure as Code (IaC) platforms: Terraform, Ansible, or CloudFormation with exposure to multiple cloud environments (AWS, GCP, Azure, OCI)Strong technical leadership in test automation frameworks, CI/CD pipeline development, and quality engineering practicesFamiliarity with containerization and orchestration tools such as Docker and Kubernetes for leading AI/ML workloads and GPU resourcesProven success building and scaling teams in fast-paced, high-growth environmentsEffective interpersonal skills to collaborate with remote teams and build agreementProficiency in Python, Rust, or related programming languages along with the capability to engage in architecture conversationsDemonstrated history of operational proficiency encompassing 24x7 on-call oversight, SRE methodologies, and robust high-availability infrastructuresWays to stand out from the crowd:Experience with CI/CD (specifically GitHub Actions), releasing Open-source AI softwareProficient in Deep AI/ML infrastructure with expertise in NVIDIA technologies such as CUDA, TensorRT, Dynamo and Triton Inference Server, including coordinating GPU cluster operations and GPU workload performance benchmarkingBackground in DevOps, system software testing, and previous experience leading teams on inference engines, model serving platforms, or AI acceleration frameworksTrack record with monitoring tools (Prometheus, Grafana), security scanning, static/dynamic analysis tools, and license compliance automation for critical AI inferencing frameworks.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 425,500 USD for Level 4.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until September 29, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.