Software Engineer 3 - Building MongoDB's Next-Gen AI Inference Platform

Role Overview

Join MongoDB as a Software Engineer 3 and power the future of AI-native applications with our modern developer data platform. We're seeking exceptional engineers to build the next-generation inference platform that supports embedding models for semantic search, retrieval, and transformative AI experiences in MongoDB Atlas.

You'll collaborate with ML researchers and engineers from our Voyage.ai acquisition within the Search and AI Platform organization. Together, you'll create real-time, low-latency, high-scale inference infrastructure fully integrated with Atlas—designed specifically for developer-first experiences that scale to millions of users.

As a key contributor, you'll own critical components of our multi-tenant inference systems, ensure seamless Atlas integration, and deliver a platform renowned for reliability, performance, and developer ease. Based in Palo Alto, California or Seattle, Washington, this hybrid role offers the perfect blend of collaboration and flexibility.

Key Responsibilities at MongoDB

• Design and implement core components of our multi-tenant inference platform directly integrated with MongoDB Atlas for semantic search and hybrid retrieval capabilities.
• Partner with AI engineers and researchers to productionize inference pipelines for embedding models and rerankers, supporting both batch processing and real-time applications.
• Build advanced platform features including latency-aware routing, model versioning, comprehensive health monitoring, and full observability stacks.
• Drive continuous improvements in performance optimization, autoscaling efficiency, GPU utilization, and resource management within cloud-native environments.
• Collaborate across product, infrastructure, and ML teams to meet the scale, reliability, and latency requirements demanded by Atlas customers worldwide.
• Gain hands-on expertise with cutting-edge tools like vLLM inference engine and Kubernetes container orchestration.
• Contribute to vector search systems leveraging technologies like Faiss, HNSW, and ScaNN for production-grade performance.
• Enable retrieval-augmented generation (RAG) and hybrid retrieval patterns that power modern AI applications.

Qualifications & Requirements

To succeed in this Software Engineer 3 role at MongoDB, you'll bring:

• 2+ years of experience building backend systems or infrastructure that scales to production workloads.
• Expertise in performance-critical languages like Go, Rust, Python, or C++, with proven focus on reliability and efficiency.
• Deep knowledge of cloud-native architectures, distributed systems design, and multi-tenant service patterns.
• Familiarity with ML inference concepts and model serving runtimes, even without direct model deployment experience.
• Bonus: Experience with vector search technologies (Faiss, HNSW, ScaNN) and production ML infrastructure integration.
• Bonus: Understanding of hybrid retrieval, RAG systems, and prompt-driven AI architectures.

You're a collaborative problem-solver motivated to build systems that power MongoDB Atlas for thousands of developers globally.

Salary & Benefits

MongoDB offers competitive compensation for Software Engineer 3 roles ranging from $180,000 - $260,000 base salary (USD), plus equity, bonuses, and comprehensive benefits. Our total rewards package includes:

• Competitive Equity Packages with significant growth potential
• Wellness Programs including mental health support
• MongoDB University for continuous learning
• Global Family Leave policy
• Hybrid work flexibility in prime tech hubs
• 401(k) matching and financial planning
• Unlimited PTO and flexible holidays
• Comprehensive health coverage (medical, dental, vision)

Why Join MongoDB?

MongoDB is redefining databases for the AI era. Our cloud-native Atlas platform—the world's most widely available, globally distributed database—powers 75% of Fortune 100 companies and innovative AI startups across AWS, Google Cloud, and Azure.

With nearly 60,000 customers worldwide, you'll build infrastructure that handles massive scale while enabling developers to innovate rapidly. Join a culture guided by our Leadership Commitment, where personal growth meets business impact in a supportive, enriching environment.

Work on cutting-edge AI infrastructure that integrates seamlessly with NoSQL power, vector search, and modern developer workflows. This is your chance to shape the future of AI-native applications at scale.

How to Apply

Ready to build the AI inference platform powering MongoDB Atlas? Apply now for this Software Engineer 3 position in Palo Alto or Seattle. Submit your resume and join thousands of engineers transforming how the world builds software.

Keywords: MongoDB careers, Software Engineer jobs, AI inference engineer, vector search developer, Atlas platform engineering, Go Rust Python jobs, Kubernetes ML infrastructure.