Resume and JobRESUME AND JOB
Datadog logo

Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!

Datadog

Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!

full-timePosted: Jan 21, 2026

Job Description

Role Overview

Datadog's Senior Staff GenAI Engineer - Application Performance Monitoring (APM) role represents a rare opportunity to shape the future of cloud observability. Join our APM team in New York, New York to lead revolutionary GenAI-powered agentic workflows that transform how developers troubleshoot and optimize distributed applications. APM provides unparalleled visibility through distributed tracing, continuous profiling, and seamless correlation with logs, metrics, and security signals.

As a technical leader, you'll design and deploy ML models that automate incident investigations, making Datadog the undisputed leader in intelligent observability. This hybrid role combines NYC's vibrant tech ecosystem with flexible work-life harmony, perfect for senior engineers passionate about production ML at scale.

Key Responsibilities at Datadog

  • Lead GenAI Strategy: Own technical direction for agentic workflows across APM and related observability products
  • Model Development: Build, train, evaluate, and deploy state-of-the-art GenAI/ML models for performance analysis
  • Cross-Team Leadership: Guide multiple engineering teams through design, implementation, and production rollout
  • Product Influence: Drive product roadmap with deep understanding of customer pain points in APM troubleshooting
  • Automated Investigations: Collaborate on AI agents that automatically triage and resolve application performance issues
  • Technical Mentorship: Shape engineering culture through design reviews, tech talks, and senior engineering community contributions
  • Scale Solutions: Navigate ambiguity to deliver reliable ML systems handling petabytes of telemetry data daily
  • Innovation Leadership: Benchmark against industry SOTA and pioneer new capabilities in observability AI
  • End-to-End Ownership: Ship customer-facing features from research prototype to production excellence

Qualifications & Requirements

  • BS/MS/PhD in Computer Science, Machine Learning, Statistics, or equivalent with 10+ years engineering experience
  • 4+ years leading cross-team GenAI/ML initiatives with proven production impact
  • Deep expertise across the ML stack: data pipelines, model training, evaluation, deployment, and monitoring
  • Experience with LLMs, RAG systems, and agentic architectures in production environments
  • Strong systems engineering background comfortable with distributed systems, cloud infrastructure (AWS/GCP/Azure)
  • Product-minded engineer who can translate customer needs into technical requirements
  • Excellent communicator who thrives leading through influence across engineering, product, and design

Bonus: Experience with observability tooling, distributed tracing (OpenTelemetry), or performance profiling.

Salary & Benefits

Datadog offers competitive total compensation for senior staff engineers in NYC, including base salary, significant equity, and performance bonuses. Our comprehensive benefits package includes:

  • Family health insurance with low deductibles
  • Fitness reimbursements up to $100/month
  • Commuter benefits covering MTA and PATH
  • Professional development budget for conferences like NeurIPS, re:Invent
  • Unlimited PTO with wellness days
  • Hybrid NYC office with modern collaboration spaces
  • 401(k) matching and financial planning
  • Parental leave and family support programs

Why Join Datadog?

Datadog powers the world's most innovative companies with cloud-scale observability. As a Senior Staff GenAI Engineer, you'll work on problems that matter with engineers who ship daily. Our NYC headquarters fosters creativity through spontaneous collaboration while supporting hybrid flexibility.

Be part of pioneering agentic APM - where AI doesn't just alert, it investigates and resolves. Join 3,000+ Datadogs building the future of observability at unprecedented scale. With products monitoring 800M+ containers monthly, your work impacts Fortune 500 engineering teams worldwide.

Datadog's engineering culture emphasizes ownership, innovation, and customer obsession. Senior leaders like you shape our technical vision while mentoring the next generation of observability experts.

How to Apply

Ready to lead GenAI innovation in APM? Apply now for immediate consideration. Include your GitHub/resume showcasing production ML impact and availability for NYC hybrid work. Datadog is an Equal Opportunity Employer committed to diversity.

Join us in making observability intelligent. Your leadership will define how developers experience application performance forever.

Locations

  • New York, New York, United States

Salary

Estimated Salary Rangehigh confidence

262,500 - 440,000 USD / yearly

Source: ai estimated

* This is an estimated range based on market data and may vary based on experience and qualifications.

Skills Required

  • Generative AIintermediate
  • Machine Learningintermediate
  • Application Performance Monitoringintermediate
  • Distributed Tracingintermediate
  • Cloud Observabilityintermediate
  • DevOpsintermediate
  • Pythonintermediate
  • LLM Fine-tuningintermediate
  • Agentic Workflowsintermediate
  • Model Deploymentintermediate
  • Kubernetesintermediate
  • AWSintermediate
  • Telemetry Analysisintermediate
  • Profiling Toolsintermediate
  • Incident Troubleshootingintermediate

Required Qualifications

  • BS/MS/PhD in Computer Science, Machine Learning, or related scientific field or equivalent practical experience (experience)
  • 10+ years of software engineering experience with 4+ years leading cross-team GenAI/ML initiatives (experience)
  • Proven track record shipping large-scale GenAI/ML models in production environments (experience)
  • Deep expertise in building, training, evaluating, and deploying ML models at scale (experience)
  • Strong product mindset with experience influencing product direction through technical leadership (experience)
  • Excellent communication skills and experience mentoring engineering teams (experience)

Responsibilities

  • Serve as technical owner for GenAI initiatives within Datadog APM, leading design and deployment across teams
  • Guide long-term strategy for agentic workflows and GenAI features in APM and related products
  • Build, benchmark, and optimize GenAI/ML models using state-of-the-art techniques
  • Collaborate with cross-functional teams to develop automated investigation and triaging tools
  • Influence product roadmap by advocating for end-user needs with strong product thinking
  • Mentor engineers through design reviews, technical talks, and working groups
  • Navigate technical ambiguity and scaling challenges with clear direction
  • Contribute to Datadog's engineering community through thought leadership
  • Drive end-to-end delivery of ML/AI-powered APM features

Benefits

  • general: Competitive equity package with significant ownership potential
  • general: Comprehensive health insurance covering family members
  • general: Generous commuter benefits for NYC public transit
  • general: Fitness reimbursements including gym memberships and wellness programs
  • general: Professional development stipend for conferences and certifications
  • general: Unlimited PTO with encouraged work-life harmony
  • general: Hybrid workplace with collaborative NYC office culture
  • general: 401(k) matching and financial planning services
  • general: Parental leave and family-friendly policies
  • general: Daily catered meals and fully stocked kitchens

Target Your Resume for "Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!" , Datadog

Get personalized recommendations to optimize your resume specifically for Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!. Takes only 15 seconds!

AI-powered keyword optimization
Skills matching & gap analysis
Experience alignment suggestions

Check Your ATS Score for "Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!" , Datadog

Find out how well your resume matches this job's requirements. Get comprehensive analysis including ATS compatibility, keyword matching, skill gaps, and personalized recommendations.

ATS compatibility check
Keyword optimization analysis
Skill matching & gap identification
Format & readability score

Tags & Categories

GenAIMachine LearningAPMObservabilitySenior StaffNew YorkHybridLeadershipCloudDevOpsSenior Staff GenAI Engineer DatadogApplication Performance Monitoring jobs NYCGenAI ML Engineer observabilityDatadog APM careers New YorkAgentic workflows engineering jobsSenior ML Engineer cloud monitoringDistributed tracing GenAI jobsStaff engineer APM DatadogGenerative AI observability careersProduction ML engineer New YorkDatadog engineering jobs NYCSenior Staff Software Engineer GenAICloud observability ML jobsIncident troubleshooting AI engineerDatadog hybrid engineering rolesGenAI APM leadership positionsStaff engineer distributed systems NYCDev Eng

Answer 10 quick questions to check your fit for Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now! @ Datadog.

Quiz Challenge
10 Questions
~2 Minutes
Instant Score

Related Books and Jobs

No related jobs found at the moment.

Datadog logo

Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!

Datadog

Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!

full-timePosted: Jan 21, 2026

Job Description

Role Overview

Datadog's Senior Staff GenAI Engineer - Application Performance Monitoring (APM) role represents a rare opportunity to shape the future of cloud observability. Join our APM team in New York, New York to lead revolutionary GenAI-powered agentic workflows that transform how developers troubleshoot and optimize distributed applications. APM provides unparalleled visibility through distributed tracing, continuous profiling, and seamless correlation with logs, metrics, and security signals.

As a technical leader, you'll design and deploy ML models that automate incident investigations, making Datadog the undisputed leader in intelligent observability. This hybrid role combines NYC's vibrant tech ecosystem with flexible work-life harmony, perfect for senior engineers passionate about production ML at scale.

Key Responsibilities at Datadog

  • Lead GenAI Strategy: Own technical direction for agentic workflows across APM and related observability products
  • Model Development: Build, train, evaluate, and deploy state-of-the-art GenAI/ML models for performance analysis
  • Cross-Team Leadership: Guide multiple engineering teams through design, implementation, and production rollout
  • Product Influence: Drive product roadmap with deep understanding of customer pain points in APM troubleshooting
  • Automated Investigations: Collaborate on AI agents that automatically triage and resolve application performance issues
  • Technical Mentorship: Shape engineering culture through design reviews, tech talks, and senior engineering community contributions
  • Scale Solutions: Navigate ambiguity to deliver reliable ML systems handling petabytes of telemetry data daily
  • Innovation Leadership: Benchmark against industry SOTA and pioneer new capabilities in observability AI
  • End-to-End Ownership: Ship customer-facing features from research prototype to production excellence

Qualifications & Requirements

  • BS/MS/PhD in Computer Science, Machine Learning, Statistics, or equivalent with 10+ years engineering experience
  • 4+ years leading cross-team GenAI/ML initiatives with proven production impact
  • Deep expertise across the ML stack: data pipelines, model training, evaluation, deployment, and monitoring
  • Experience with LLMs, RAG systems, and agentic architectures in production environments
  • Strong systems engineering background comfortable with distributed systems, cloud infrastructure (AWS/GCP/Azure)
  • Product-minded engineer who can translate customer needs into technical requirements
  • Excellent communicator who thrives leading through influence across engineering, product, and design

Bonus: Experience with observability tooling, distributed tracing (OpenTelemetry), or performance profiling.

Salary & Benefits

Datadog offers competitive total compensation for senior staff engineers in NYC, including base salary, significant equity, and performance bonuses. Our comprehensive benefits package includes:

  • Family health insurance with low deductibles
  • Fitness reimbursements up to $100/month
  • Commuter benefits covering MTA and PATH
  • Professional development budget for conferences like NeurIPS, re:Invent
  • Unlimited PTO with wellness days
  • Hybrid NYC office with modern collaboration spaces
  • 401(k) matching and financial planning
  • Parental leave and family support programs

Why Join Datadog?

Datadog powers the world's most innovative companies with cloud-scale observability. As a Senior Staff GenAI Engineer, you'll work on problems that matter with engineers who ship daily. Our NYC headquarters fosters creativity through spontaneous collaboration while supporting hybrid flexibility.

Be part of pioneering agentic APM - where AI doesn't just alert, it investigates and resolves. Join 3,000+ Datadogs building the future of observability at unprecedented scale. With products monitoring 800M+ containers monthly, your work impacts Fortune 500 engineering teams worldwide.

Datadog's engineering culture emphasizes ownership, innovation, and customer obsession. Senior leaders like you shape our technical vision while mentoring the next generation of observability experts.

How to Apply

Ready to lead GenAI innovation in APM? Apply now for immediate consideration. Include your GitHub/resume showcasing production ML impact and availability for NYC hybrid work. Datadog is an Equal Opportunity Employer committed to diversity.

Join us in making observability intelligent. Your leadership will define how developers experience application performance forever.

Locations

  • New York, New York, United States

Salary

Estimated Salary Rangehigh confidence

262,500 - 440,000 USD / yearly

Source: ai estimated

* This is an estimated range based on market data and may vary based on experience and qualifications.

Skills Required

  • Generative AIintermediate
  • Machine Learningintermediate
  • Application Performance Monitoringintermediate
  • Distributed Tracingintermediate
  • Cloud Observabilityintermediate
  • DevOpsintermediate
  • Pythonintermediate
  • LLM Fine-tuningintermediate
  • Agentic Workflowsintermediate
  • Model Deploymentintermediate
  • Kubernetesintermediate
  • AWSintermediate
  • Telemetry Analysisintermediate
  • Profiling Toolsintermediate
  • Incident Troubleshootingintermediate

Required Qualifications

  • BS/MS/PhD in Computer Science, Machine Learning, or related scientific field or equivalent practical experience (experience)
  • 10+ years of software engineering experience with 4+ years leading cross-team GenAI/ML initiatives (experience)
  • Proven track record shipping large-scale GenAI/ML models in production environments (experience)
  • Deep expertise in building, training, evaluating, and deploying ML models at scale (experience)
  • Strong product mindset with experience influencing product direction through technical leadership (experience)
  • Excellent communication skills and experience mentoring engineering teams (experience)

Responsibilities

  • Serve as technical owner for GenAI initiatives within Datadog APM, leading design and deployment across teams
  • Guide long-term strategy for agentic workflows and GenAI features in APM and related products
  • Build, benchmark, and optimize GenAI/ML models using state-of-the-art techniques
  • Collaborate with cross-functional teams to develop automated investigation and triaging tools
  • Influence product roadmap by advocating for end-user needs with strong product thinking
  • Mentor engineers through design reviews, technical talks, and working groups
  • Navigate technical ambiguity and scaling challenges with clear direction
  • Contribute to Datadog's engineering community through thought leadership
  • Drive end-to-end delivery of ML/AI-powered APM features

Benefits

  • general: Competitive equity package with significant ownership potential
  • general: Comprehensive health insurance covering family members
  • general: Generous commuter benefits for NYC public transit
  • general: Fitness reimbursements including gym memberships and wellness programs
  • general: Professional development stipend for conferences and certifications
  • general: Unlimited PTO with encouraged work-life harmony
  • general: Hybrid workplace with collaborative NYC office culture
  • general: 401(k) matching and financial planning services
  • general: Parental leave and family-friendly policies
  • general: Daily catered meals and fully stocked kitchens

Target Your Resume for "Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!" , Datadog

Get personalized recommendations to optimize your resume specifically for Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!. Takes only 15 seconds!

AI-powered keyword optimization
Skills matching & gap analysis
Experience alignment suggestions

Check Your ATS Score for "Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now!" , Datadog

Find out how well your resume matches this job's requirements. Get comprehensive analysis including ATS compatibility, keyword matching, skill gaps, and personalized recommendations.

ATS compatibility check
Keyword optimization analysis
Skill matching & gap identification
Format & readability score

Tags & Categories

GenAIMachine LearningAPMObservabilitySenior StaffNew YorkHybridLeadershipCloudDevOpsSenior Staff GenAI Engineer DatadogApplication Performance Monitoring jobs NYCGenAI ML Engineer observabilityDatadog APM careers New YorkAgentic workflows engineering jobsSenior ML Engineer cloud monitoringDistributed tracing GenAI jobsStaff engineer APM DatadogGenerative AI observability careersProduction ML engineer New YorkDatadog engineering jobs NYCSenior Staff Software Engineer GenAICloud observability ML jobsIncident troubleshooting AI engineerDatadog hybrid engineering rolesGenAI APM leadership positionsStaff engineer distributed systems NYCDev Eng

Answer 10 quick questions to check your fit for Senior Staff GenAI Engineer - Application Performance Monitoring Careers at Datadog - New York, New York | Apply Now! @ Datadog.

Quiz Challenge
10 Questions
~2 Minutes
Instant Score

Related Books and Jobs

No related jobs found at the moment.