Overview

OCI is seeking a highly skilled Principal Applied Scientist for our GenAI Evaluation team, focusing on LLM and LMM evaluation. The ideal candidate brings expertise in NLP, computer vision, machine learning, and software development. Join us to drive innovation in research, collaboration, and cutting-edge AI evaluation.

Responsibilities

• Lead development and implementation of advanced evaluation frameworks for LLMs and LMMs.
• Design metrics and benchmarks to assess model performance across diverse tasks.
• Conduct rigorous experiments to evaluate model capabilities in NLP and computer vision.
• Collaborate with cross-functional teams to integrate evaluation insights into product development.
• Research and innovate new methods for data quality assessment and bias detection.
• Develop scalable software tools and pipelines for automated model evaluation.
• Publish findings and represent OCI at top AI conferences.
• Mentor junior scientists and guide team on best practices in AI evaluation.

Qualifications

• PhD in Computer Science, Machine Learning, or related field with 8+ years of experience.
• Deep expertise in NLP, computer vision, or multimodal AI systems.
• Proven track record in LLM/LMM evaluation and benchmarking.
• Strong programming skills in Python, PyTorch/TensorFlow, and cloud platforms.
• Experience with research publication in top-tier AI/ML venues.
• Excellent collaboration and communication skills in fast-paced environments.

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• 401(k) matching and employee stock purchase plan.
• Flexible remote/hybrid work options across US locations.
• Professional development stipend and conference travel support.