Role Overview

Join Datadog's cutting-edge AI Platform Engineering team as Manager II, Engineering - AI Platform Training, Serving and Storage in New York, New York. This is a rare opportunity to lead the infrastructure powering Datadog's AI innovation including Bits AI, LLM Observability, and groundbreaking AI research. You'll manage a fast-growing team of ~20 engineers across multiple teams, define the technical vision for scalable AI infrastructure, and partner with Applied AI, product engineering, and infrastructure teams to deliver world-class MLOps platforms.

Datadog's AI Platform mission is to empower data scientists and engineers with tools for large-scale training and inference. As a senior engineering leader, you'll build from 0-to-1 using open source tooling like Ray and AnyScale, create organizational culture, and drive the complete AI lifecycle from model training to production monitoring. This hybrid role in our NYC office offers the perfect blend of collaboration and work-life harmony.

Key Responsibilities at Datadog

• Lead and scale fast-growing organization of ~20 people across 2 teams (expanding to 3)
• Define technical roadmap and vision for AI Platform Training, Serving, and Storage
• Manage engineering managers and shape future organizational structure
• Collaborate closely with product managers to prioritize and deliver roadmap
• Build engineering culture centered on Datadog standards and customer obsession
• Support full AI lifecycle: model training, serving, deployment, and observability
• Partner cross-functionally with Applied AI, product, and infrastructure teams
• Drive talent acquisition for future managers and individual contributors
• Influence technical direction through hands-on engineering leadership

Qualifications & Requirements

Datadog seeks proven leaders who thrive in ambiguity and deliver impact. Ideal candidates bring:

• 0-to-1 ML/AI Platform experience building with open source tooling (Ray, AnyScale preferred)
• Senior engineering management experience including managing managers
• Deep technical expertise in distributed ML systems, training, serving, and monitoring
• Proven delivery track record of high-quality software on aggressive schedules
• Strong collaboration skills working with product and cross-functional partners
• Customer-focused mindset with bias for action in early-stage environments

Datadog values growth mindset. If you're passionate about AI infrastructure and want to level up your career, we encourage you to apply even if you don't meet every qualification.

Salary & Benefits

Salary Range: $234,000 - $300,000 USD (base salary) plus competitive equity package and variable compensation. Total compensation based on experience and qualifications.

• Equity: New hire RSUs + Employee Stock Purchase Plan (ESPP)
• Health: Comprehensive medical, dental, vision for employees + dependents
• Mental Health: Free global benefits for employees and dependents age 6+
• Retirement: 401(k) with generous company match
• Time Off: Unlimited PTO + flexible hybrid work model
• Wellness: Fitness reimbursements + wellness programs
• Development: Continuous learning, career pathing, product training
• Culture: Mentor programs, Community Guilds, Inclusion Talks

Why Join Datadog?

Datadog (NASDAQ: DDOG) combines explosive growth with profitability in the $100B+ observability market. Our AI Platform powers innovative products like Bits AI (generative AI) and LLM Observability, positioning Datadog as the leader in AI infrastructure monitoring.

Join a hybrid NYC office culture that fosters creativity, collaboration, and relationships. Work with the brightest minds in cloud observability, DevOps, and AI while enjoying unmatched growth opportunities and compensation. Datadog's inclusive culture welcomes diverse backgrounds through our Community Guilds and Inclusion Talks.

Be part of the team defining the future of AI infrastructure at scale. With our bias for action and customer obsession, you'll deliver impact from day one while growing your career at a profitable SaaS leader.

How to Apply

Ready to lead Datadog's AI Platform revolution? Apply now for this Manager II, Engineering role in New York. Submit your resume and tell us why you're passionate about building scalable AI infrastructure with Ray and open source tooling.

Datadog is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Join us in powering the world's leading cloud applications with unmatched observability and AI innovation.