Role Overview

Join MongoDB as a Lead Engineer, Inference Platform and shape the future of AI-native developer experiences on the world's most popular modern developer data platform. This hands-on technical leadership role sits at the intersection of MongoDB Atlas Vector Search, cutting-edge embedding models from our Voyage.ai acquisition, and high-scale inference infrastructure. You'll build the real-time, low-latency systems powering semantic search, hybrid retrieval, and RAG pipelines for thousands of global customers.

Based in Palo Alto, California or Seattle, Washington for our hybrid model, you'll lead key projects optimizing GPU utilization, autoscaling, and observability in a multi-tenant, cloud-native environment deeply integrated with MongoDB Atlas across AWS, Google Cloud, and Microsoft Azure.

Key Responsibilities at MongoDB

• Partner closely with Search Platform and Voyage.ai AI engineers to productionize state-of-the-art embedding models and rerankers for both batch and real-time inference
• Lead critical projects focused on performance optimization, GPU utilization, autoscaling, and comprehensive observability for the inference platform
• Design and implement components of our multi-tenant inference service that powers Atlas Vector Search capabilities for semantic search and hybrid retrieval
• Build essential platform features like model versioning, safe deployment pipelines, latency-aware routing, and model health monitoring
• Collaborate with ML, infrastructure, and product teams to establish architectural patterns ensuring high availability and low latency at scale
• Guide technical decisions on model serving architecture leveraging tools like vLLM, ONNX Runtime, and Kubernetes container orchestration
• Provide hands-on technical leadership and mentorship to engineers across experience levels
• Foster a culture of technical excellence, autonomy, and continuous improvement within the team

Qualifications & Requirements

To succeed as our Lead Engineer, Inference Platform, you'll bring:

• 8+ years of engineering experience in backend systems, ML infrastructure, or scalable platform development with proven technical leadership
• Deep expertise serving embedding models in production environments at global scale
• Strong systems programming in Go, Rust, C++, or Python with experience profiling and optimizing performance
• Proven experience building cloud-native distributed systems emphasizing latency, availability, and observability
• Familiarity with inference runtimes (vLLM, ONNX Runtime) and vector search systems (Faiss, HNSW, ScaNN)
• 1+ years experience serving as Technical Lead for large-scale ML inference or training platform projects
• Track record of cross-discipline collaboration from ML researchers to junior engineers in multi-tenant SaaS environments

Nice to haves: Experience with hybrid retrieval, RAG, open-source ML serving contributions, or managing ML infrastructure teams.

Salary & Benefits

Lead Engineer, Inference Platform roles at MongoDB offer competitive Total Compensation packages including base salary, equity, and comprehensive benefits. Expected range: $220,000 - $350,000 USD (Palo Alto/Seattle) depending on experience.

• Competitive base salary + significant equity ownership in high-growth public company
• Comprehensive wellness programs including mental health support
• MongoDB University for certifications and skill development
• Global Family Leave with generous parental policies
• 401(k) matching and ESPP programs
• Unlimited PTO and flexible hybrid schedules
• Annual learning stipend for conferences and courses
• Premium health insurance (medical, dental, vision)

Why Join MongoDB?

Be part of redefining databases for the AI era. MongoDB powers innovators building AI-native applications on our globally distributed, multi-cloud platform. Work with Voyage.ai ML experts to bring cutting-edge research into production, solving real-time inference challenges at unprecedented scale.

• Shape AI-native developer experiences on the #1 developer data platform
• Solve hard problems in real-time inference and semantic retrieval for global customers
• Thrive in a culture valuing mentorship, autonomy, and technical craft
• Join 4,000+ talented engineers modernizing legacy workloads and unleashing AI

How to Apply

Ready to lead MongoDB's inference platform into the AI future? Apply now if you're in Palo Alto or Seattle and have production embedding model expertise. Our team reviews applications continuously—don't miss this chance to build scalable AI infrastructure at the world's leading NoSQL database platform.

Keywords: MongoDB Atlas, Vector Search, ML Inference, Kubernetes, Go, Rust, Semantic Search, RAG, Voyage.ai, GPU Optimization