Resume and JobRESUME AND JOB
Datadog logo

Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!

Datadog

Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!

full-timePosted: Jan 21, 2026

Job Description

Role Overview

Datadog, the leading cloud monitoring and security platform, is hiring a Staff GenAI Engineer - Application Performance Monitoring (APM) in New York, New York. Join our APM team to revolutionize how developers troubleshoot applications using cutting-edge Generative AI and machine learning. Our APM product delivers unparalleled visibility through distributed tracing, continuous profiling, and seamless correlation across logs, metrics, and traces.

As a technical leader, you'll pioneer agentic AI workflows that automatically investigate incidents, identify root causes, and recommend fixes. This role combines deep ML expertise with product thinking to push Datadog's observability platform to world-leading capabilities in automated troubleshooting. Work in a hybrid environment that balances NYC office collaboration with work-life harmony.

Key Responsibilities at Datadog

  • Act as technical leader driving GenAI/ML projects from ideation to production deployment within APM organization
  • Build, benchmark, and optimize state-of-the-art GenAI models for application performance analysis
  • Collaborate cross-functionally to develop automated investigation tools using distributed tracing data
  • Influence product direction with strong product mindset, always prioritizing end-user experience
  • Guide teams through technical ambiguity, scaling ML models, and evolving observability requirements
  • Mentor engineers via design reviews, technical talks, and engineering culture initiatives
  • Deploy ML models at scale integrated with Datadog's cloud observability stack
  • Analyze APM telemetry to train models predicting performance bottlenecks proactively
  • Lead evaluation frameworks ensuring production-grade ML reliability

Qualifications & Requirements

  • Advanced degree (BS/MS/PhD) in Computer Science, Machine Learning, or scientific field, or equivalent experience
  • 10+ years engineering experience including technical leadership in production ML systems
  • Proven success leading large-scale GenAI initiatives in product-driven environments
  • Deep hands-on experience with model training, fine-tuning, evaluation, and deployment
  • Strong track record driving cross-functional initiatives and solving ambiguous technical challenges
  • Excellent communication and product thinking focused on developer workflows

Salary & Benefits

Competitive total compensation for Staff GenAI Engineers at Datadog includes base salary, significant equity, and performance bonuses. NYC-based roles offer premium benefits tailored for high-cost living:

  • Competitive base salary plus equity package
  • Comprehensive family health insurance
  • Commuter benefits for NYC transit
  • Fitness reimbursements and wellness programs
  • Professional development budget for ML conferences
  • Unlimited PTO and hybrid flexibility
  • 401(k) matching
  • Parental leave benefits

Why Join Datadog?

Datadog powers observability for the world's largest cloud applications. As a Staff GenAI Engineer in APM, you'll work on groundbreaking AI that transforms how SREs and developers manage production systems. Our NYC office fosters creativity through collaboration while hybrid policies support work-life balance.

Be part of the team defining agentic observability - where AI agents autonomously hunt down issues across traces, metrics, and logs. With 10+ years of ML leadership experience, you'll shape Datadog's future in cloud monitoring, DevOps automation, and AI-driven incident management.

How to Apply

Ready to lead GenAI innovation at Datadog? Apply now for the Staff GenAI Engineer - APM role in New York. Submit your resume highlighting ML production experience and leadership impact. Join thousands of engineers building the future of cloud observability.

Datadog is an Equal Opportunity Employer committed to diversity. We review applications on a rolling basis - don't wait to apply for this high-impact GenAI engineering role.

Locations

  • New York, New York, United States

Salary

Estimated Salary Rangehigh confidence

231,000 - 385,000 USD / yearly

Source: ai estimated

* This is an estimated range based on market data and may vary based on experience and qualifications.

Skills Required

  • Generative AIintermediate
  • Machine Learningintermediate
  • Application Performance Monitoringintermediate
  • Distributed Tracingintermediate
  • Cloud Observabilityintermediate
  • DevOpsintermediate
  • Model Trainingintermediate
  • Model Deploymentintermediate
  • Pythonintermediate
  • Kubernetesintermediate
  • AWSintermediate
  • Dockerintermediate
  • Prometheusintermediate
  • Grafanaintermediate
  • LLM Fine-tuningintermediate
  • Agentic AI Workflowsintermediate

Required Qualifications

  • BS/MS/PhD in Computer Science, Machine Learning, or related scientific field or equivalent practical experience (experience)
  • 10+ years of software engineering experience with proven technical leadership in GenAI/ML projects (experience)
  • Demonstrated track record leading large-scale GenAI/ML initiatives from concept to production in product-driven environments (experience)
  • Deep expertise in model development, training, fine-tuning, evaluation, and deployment at scale (experience)
  • Strong ability to drive cross-functional initiatives, solve ambiguous technical challenges, and mentor engineering teams (experience)
  • Excellent communication skills and product mindset focused on end-user advocacy (experience)

Responsibilities

  • Lead GenAI/ML projects within Datadog's APM team from concept through production deployment
  • Design, build, benchmark, and optimize state-of-the-art GenAI models for application observability
  • Develop agentic workflows for automated incident investigation and performance bottleneck detection
  • Collaborate with product, engineering, and design teams to create intelligent triaging tools
  • Influence APM product roadmap with data-driven insights and user-centric ML solutions
  • Guide engineering teams through technical ambiguity, scaling challenges, and evolving requirements
  • Mentor junior engineers through design reviews, technical talks, and working groups
  • Deploy and monitor ML models at massive scale integrated with Datadog's observability platform
  • Analyze distributed tracing data to train models that predict and prevent application issues

Benefits

  • general: Competitive equity package with significant stock options
  • general: Comprehensive health insurance covering family members
  • general: Generous commuter benefits for NYC public transportation
  • general: Fitness reimbursements including gym memberships and wellness programs
  • general: Professional development stipend for conferences and certifications
  • general: Unlimited PTO and flexible hybrid work arrangements
  • general: 401(k) matching program
  • general: Parental leave and family planning benefits
  • general: Home office setup allowance
  • general: Mental health support and employee assistance programs

Target Your Resume for "Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!" , Datadog

Get personalized recommendations to optimize your resume specifically for Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!. Takes only 15 seconds!

AI-powered keyword optimization
Skills matching & gap analysis
Experience alignment suggestions

Check Your ATS Score for "Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!" , Datadog

Find out how well your resume matches this job's requirements. Get comprehensive analysis including ATS compatibility, keyword matching, skill gaps, and personalized recommendations.

ATS compatibility check
Keyword optimization analysis
Skill matching & gap identification
Format & readability score

Tags & Categories

GenAIMachine LearningAPMObservabilityCloudDevOpsNew YorkStaff EngineerDatadog CareersStaff GenAI Engineer DatadogApplication Performance Monitoring jobs NYCGenAI ML engineer careersDatadog APM engineer New YorkAgentic AI observability jobsStaff software engineer ML DatadogCloud monitoring GenAI careersDistributed tracing ML engineerSenior GenAI engineer jobs NYCDatadog engineering jobs New YorkProduction ML deployment engineerObservability platform GenAI rolesStaff engineer APM DatadogGenerative AI DevOps careersHybrid ML engineer New YorkDatadog technical lead GenAIDev Eng

Answer 10 quick questions to check your fit for Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now! @ Datadog.

Quiz Challenge
10 Questions
~2 Minutes
Instant Score

Related Books and Jobs

No related jobs found at the moment.

Datadog logo

Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!

Datadog

Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!

full-timePosted: Jan 21, 2026

Job Description

Role Overview

Datadog, the leading cloud monitoring and security platform, is hiring a Staff GenAI Engineer - Application Performance Monitoring (APM) in New York, New York. Join our APM team to revolutionize how developers troubleshoot applications using cutting-edge Generative AI and machine learning. Our APM product delivers unparalleled visibility through distributed tracing, continuous profiling, and seamless correlation across logs, metrics, and traces.

As a technical leader, you'll pioneer agentic AI workflows that automatically investigate incidents, identify root causes, and recommend fixes. This role combines deep ML expertise with product thinking to push Datadog's observability platform to world-leading capabilities in automated troubleshooting. Work in a hybrid environment that balances NYC office collaboration with work-life harmony.

Key Responsibilities at Datadog

  • Act as technical leader driving GenAI/ML projects from ideation to production deployment within APM organization
  • Build, benchmark, and optimize state-of-the-art GenAI models for application performance analysis
  • Collaborate cross-functionally to develop automated investigation tools using distributed tracing data
  • Influence product direction with strong product mindset, always prioritizing end-user experience
  • Guide teams through technical ambiguity, scaling ML models, and evolving observability requirements
  • Mentor engineers via design reviews, technical talks, and engineering culture initiatives
  • Deploy ML models at scale integrated with Datadog's cloud observability stack
  • Analyze APM telemetry to train models predicting performance bottlenecks proactively
  • Lead evaluation frameworks ensuring production-grade ML reliability

Qualifications & Requirements

  • Advanced degree (BS/MS/PhD) in Computer Science, Machine Learning, or scientific field, or equivalent experience
  • 10+ years engineering experience including technical leadership in production ML systems
  • Proven success leading large-scale GenAI initiatives in product-driven environments
  • Deep hands-on experience with model training, fine-tuning, evaluation, and deployment
  • Strong track record driving cross-functional initiatives and solving ambiguous technical challenges
  • Excellent communication and product thinking focused on developer workflows

Salary & Benefits

Competitive total compensation for Staff GenAI Engineers at Datadog includes base salary, significant equity, and performance bonuses. NYC-based roles offer premium benefits tailored for high-cost living:

  • Competitive base salary plus equity package
  • Comprehensive family health insurance
  • Commuter benefits for NYC transit
  • Fitness reimbursements and wellness programs
  • Professional development budget for ML conferences
  • Unlimited PTO and hybrid flexibility
  • 401(k) matching
  • Parental leave benefits

Why Join Datadog?

Datadog powers observability for the world's largest cloud applications. As a Staff GenAI Engineer in APM, you'll work on groundbreaking AI that transforms how SREs and developers manage production systems. Our NYC office fosters creativity through collaboration while hybrid policies support work-life balance.

Be part of the team defining agentic observability - where AI agents autonomously hunt down issues across traces, metrics, and logs. With 10+ years of ML leadership experience, you'll shape Datadog's future in cloud monitoring, DevOps automation, and AI-driven incident management.

How to Apply

Ready to lead GenAI innovation at Datadog? Apply now for the Staff GenAI Engineer - APM role in New York. Submit your resume highlighting ML production experience and leadership impact. Join thousands of engineers building the future of cloud observability.

Datadog is an Equal Opportunity Employer committed to diversity. We review applications on a rolling basis - don't wait to apply for this high-impact GenAI engineering role.

Locations

  • New York, New York, United States

Salary

Estimated Salary Rangehigh confidence

231,000 - 385,000 USD / yearly

Source: ai estimated

* This is an estimated range based on market data and may vary based on experience and qualifications.

Skills Required

  • Generative AIintermediate
  • Machine Learningintermediate
  • Application Performance Monitoringintermediate
  • Distributed Tracingintermediate
  • Cloud Observabilityintermediate
  • DevOpsintermediate
  • Model Trainingintermediate
  • Model Deploymentintermediate
  • Pythonintermediate
  • Kubernetesintermediate
  • AWSintermediate
  • Dockerintermediate
  • Prometheusintermediate
  • Grafanaintermediate
  • LLM Fine-tuningintermediate
  • Agentic AI Workflowsintermediate

Required Qualifications

  • BS/MS/PhD in Computer Science, Machine Learning, or related scientific field or equivalent practical experience (experience)
  • 10+ years of software engineering experience with proven technical leadership in GenAI/ML projects (experience)
  • Demonstrated track record leading large-scale GenAI/ML initiatives from concept to production in product-driven environments (experience)
  • Deep expertise in model development, training, fine-tuning, evaluation, and deployment at scale (experience)
  • Strong ability to drive cross-functional initiatives, solve ambiguous technical challenges, and mentor engineering teams (experience)
  • Excellent communication skills and product mindset focused on end-user advocacy (experience)

Responsibilities

  • Lead GenAI/ML projects within Datadog's APM team from concept through production deployment
  • Design, build, benchmark, and optimize state-of-the-art GenAI models for application observability
  • Develop agentic workflows for automated incident investigation and performance bottleneck detection
  • Collaborate with product, engineering, and design teams to create intelligent triaging tools
  • Influence APM product roadmap with data-driven insights and user-centric ML solutions
  • Guide engineering teams through technical ambiguity, scaling challenges, and evolving requirements
  • Mentor junior engineers through design reviews, technical talks, and working groups
  • Deploy and monitor ML models at massive scale integrated with Datadog's observability platform
  • Analyze distributed tracing data to train models that predict and prevent application issues

Benefits

  • general: Competitive equity package with significant stock options
  • general: Comprehensive health insurance covering family members
  • general: Generous commuter benefits for NYC public transportation
  • general: Fitness reimbursements including gym memberships and wellness programs
  • general: Professional development stipend for conferences and certifications
  • general: Unlimited PTO and flexible hybrid work arrangements
  • general: 401(k) matching program
  • general: Parental leave and family planning benefits
  • general: Home office setup allowance
  • general: Mental health support and employee assistance programs

Target Your Resume for "Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!" , Datadog

Get personalized recommendations to optimize your resume specifically for Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!. Takes only 15 seconds!

AI-powered keyword optimization
Skills matching & gap analysis
Experience alignment suggestions

Check Your ATS Score for "Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now!" , Datadog

Find out how well your resume matches this job's requirements. Get comprehensive analysis including ATS compatibility, keyword matching, skill gaps, and personalized recommendations.

ATS compatibility check
Keyword optimization analysis
Skill matching & gap identification
Format & readability score

Tags & Categories

GenAIMachine LearningAPMObservabilityCloudDevOpsNew YorkStaff EngineerDatadog CareersStaff GenAI Engineer DatadogApplication Performance Monitoring jobs NYCGenAI ML engineer careersDatadog APM engineer New YorkAgentic AI observability jobsStaff software engineer ML DatadogCloud monitoring GenAI careersDistributed tracing ML engineerSenior GenAI engineer jobs NYCDatadog engineering jobs New YorkProduction ML deployment engineerObservability platform GenAI rolesStaff engineer APM DatadogGenerative AI DevOps careersHybrid ML engineer New YorkDatadog technical lead GenAIDev Eng

Answer 10 quick questions to check your fit for Staff GenAI Engineer - Application Performance Monitoring (APM) Careers at Datadog - New York, New York | Apply Now! @ Datadog.

Quiz Challenge
10 Questions
~2 Minutes
Instant Score

Related Books and Jobs

No related jobs found at the moment.