NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a Software Architect to define and lead the technical vision for the NVIDIA Inference Microservices (NIM) Factory. You will set the architectural direction for how we build, deploy, and scale enterprise-grade AI services to delight customers, while staying hands-on to guide our most critical implementations. The scope spans day-0 launches and the follow-through to harden them into enterprise-grade software, ensuring reliability, performance, and security across thousands of GPUs. You will shape our strategy for emerging challenges like disaggregated LLM inference and safeguard the long-term technical health of the platform.What you'll be doing:Define the end-to-end technical architecture for the NIM Factory, from container build systems and CI/CD to Kubernetes deployment patterns and runtime optimization.Drive technical strategy and roadmap, making high-impact decisions on frameworks, technologies, and standards that empower dozens of engineering teams.Architect and influence the design of workflow orchestration systems that underpin the NIM factory.Coach and mentor senior engineers across the organization, fostering a culture of technical excellence, innovation, and knowledge sharing.Champion best practices in software development, including API design, automation, observability, and secure supply chain management.Collaborate with leadership across research, backend, SRE, and product to align technical vision with product goals and influence technical roadmaps.What we need to see:12+ years of experience designing and building large-scale, production distributed systems.Proven track record in a technical leadership or architect role, setting technical direction while staying hands-on with implementation.Deep architectural expertise in cloud-native technologies, including Kubernetes, containers, and microservices.Exceptional ability to coach, teach, and influence senior engineers; a passion for raising the technical bar of the entire organization.Strong foundation in modern software development practices, with proficiency in languages like Python for building tooling and services.Experience architecting solutions for GPU-accelerated or other high-performance computing workloads.Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to diverse audiences and drive consensus.A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience.Ways to stand out from the crowd:Hands-on with LLM inference stacks (Triton Inference Server, TensorRT-LLM, vLLM, FasterTransformer, KServe).Experience optimizing large-model serving (KV cache sharding/paging, tensor/sequence parallelism, speculative decoding, dynamic batching).Experience architecting next-generation container build systems or CI/CD platforms at scale.Background with workflow orchestration engines (e.g., Temporal, Airflow) for complex, distributed processes.Expertise in designing multi-tenant, multi-cluster, or edge/air-gapped deployment architectures.We are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and creative people in the world working for us. If you're creative and autonomous with a real passion for technology, we want to hear from you.