LLM & AI DevOps Engineer - Remote Opportunity at Robert Half

Are you a DevOps expert passionate about AI and Large Language Models (LLMs)? Robert Half is seeking a talented LLM & AI DevOps Engineer to join our innovative team in a fully remote capacity serving our Illinois-based clients. This is your chance to architect cutting-edge AI infrastructure, optimize NVIDIA GPU-powered environments, and drive the future of scalable AI platforms. With a competitive salary starting at $120,000, you'll work on high-impact projects that blend DevOps mastery with the latest in artificial intelligence.

In this role, you'll bridge the gap between development and operations in the fast-evolving world of AI/ML. From building robust CI/CD pipelines to deploying containerized LLM workloads on Kubernetes, you'll ensure seamless model training, inference, and monitoring. If you thrive in cloud-native environments using tools like Terraform, Ansible, Grafana, and Prometheus, this position offers unparalleled growth in the booming AI sector.

About the Role

As an LLM & AI DevOps Engineer at Robert Half, you'll be at the forefront of AI infrastructure innovation. Our clients rely on us to deliver production-ready AI solutions that power everything from generative AI chatbots to advanced predictive analytics. Working remotely from Illinois, you'll collaborate with top AI engineers, data scientists, and stakeholders to create resilient, scalable systems. This full-time position emphasizes modern DevOps practices, Infrastructure as Code (IaC), and GPU optimization, making it ideal for professionals excited about the intersection of DevOps and artificial intelligence. Expect to handle end-to-end lifecycle management of AI workloads, ensuring high availability, security, and performance in dynamic cloud environments.

Key Responsibilities

Your day-to-day will involve hands-on technical leadership in AI DevOps:

• Design, build, and automate CI/CD pipelines tailored for AI/LLM deployments using tools like Jenkins, GitHub Actions, or GitLab CI.
• Partner closely with AI teams to enable efficient model versioning, A/B testing, and continuous deployment of machine learning models.
• Leverage IaC tools such as Terraform and Ansible to provision and manage multi-cloud infrastructure (AWS, Azure, GCP).
• Deploy and scale containerized AI applications with Kubernetes, including Helm charts and Kustomize for LLM serving.
• Set up advanced observability stacks with Grafana dashboards, Prometheus metrics, and ELK stack for real-time AI workload monitoring.
• Optimize resource utilization for NVIDIA GPU clusters, fine-tuning inference engines like TensorRT and training pipelines with CUDA.
• Enforce security best practices, including secrets management (Vault), network policies, and compliance with SOC 2, GDPR, and HIPAA standards.
• Lead incident response, root cause analysis, and proactive improvements to achieve 99.99% uptime for mission-critical AI services.
• Stay ahead of AI DevOps trends, experimenting with tools like Ray, KServe, or MLflow for enhanced MLOps capabilities.

Required Qualifications

To succeed, you'll bring proven expertise in AI infrastructure:

• 3-5+ years in DevOps engineering, with 1+ years focused on AI/ML pipelines.
• Deep proficiency in Kubernetes, Docker, and container orchestration for AI workloads.
• Expertise in IaC with Terraform, Ansible, or Pulumi; cloud certifications (CKA, AWS DevOps) a plus.
• Hands-on experience optimizing NVIDIA GPUs for model training/inference (CUDA, NCCL).
• Strong skills in monitoring (Prometheus, Grafana) and logging (Loki, Fluentd).
• Familiarity with Python/Bash scripting for automation and MLOps tools.
• Bachelor's in Computer Science, Engineering, or equivalent; advanced degrees preferred.
• Excellent communication skills for cross-functional collaboration in remote settings.

Bonus: Experience with vector databases (Pinecone, Weaviate), LLM frameworks (LangChain, Hugging Face), or serverless AI deployments.

Why Join Us at Robert Half?

Robert Half offers more than just a job—it's a launchpad for your career in AI DevOps. Enjoy full remote flexibility across Illinois, a salary range of $120,000-$150,000 based on experience, and comprehensive benefits including health coverage, 401(k) matching, PTO, and professional development funds. Work on transformative AI projects with enterprise clients, gain exposure to state-of-the-art tools, and grow within a supportive, innovative culture. SEO keywords: AI DevOps jobs remote IL, LLM engineer careers, Kubernetes AI specialist, NVIDIA GPU DevOps Robert Half. Apply today to shape the future of AI infrastructure!