About the Role

You will design and implement evaluation pipelines that enable xAI’s models to self-improve through end-user interactions, building features and data flows that capture human feedback to drive continuous optimization of user value, engagement, and key metrics in consumer products reaching millions of users.

You’ll work with us on:

• Building RLHF tooling to gather and incorporate end-user preferences and feedback, enabling models to iteratively self-improve based on real-world usage
• Developing data pipelines and AI evaluation frameworks to track model performance, safety, user satisfaction, and metrics like retention and engagement from an end-user lens
• Work in product and work with our model training teams to optimize and productionize AI powered features.

You’ll flourish in this role if you:

• Have a strong grasp of scaling AI products from prototype to global deployment
• Are skilled in developing robust AI evaluation methodologies, including benchmarks and metrics for alignment and user-centric improvement
• Have hands-on experience with RLHF or similar preference-based learning systems
• Thrive in ambiguous environments, iterating quickly based on feedback loops and data-driven insights
• Are passionate about AI creating transformative and user-centric technologies
• Consider yourself a high-agency builder who bridges research and product realities

Ideal Experience

• Proven track record in RLHF implementation or AI alignment projects.
• Experience building data pipelines for metric optimization and model self-improvement in fast-paced environments.
• Familiarity with evaluation tools and frameworks (e.g., custom benchmarks, A/B testing for AI, user analytics).
• Strong portfolio or contributions demonstrating evaluation work and feature development for user impact.

Interview Process

After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15 minute interview (“phone interview”) during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process:

1. Technical deep-dive: Discussing your evaluation and pipeline experience
2. A take-home challenge on building an AI eval or feedback prototype
3. Meet and greet with the wider team.

Our goal is to finish the main process within one week.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.