Job Description

Locations

• Beijing, Beijing, China 100045

Salary

Skills Required

• computer visionintermediate
• deep learningintermediate
• machine learningintermediate
• evaluating machine learning modelsintermediate
• developing performance metricsintermediate
• failure analysisintermediate
• machine learning algorithmsintermediate
• data processingintermediate
• model optimization techniquesintermediate
• assessing model qualityintermediate
• analyzing machine learning modelsintermediate
• validating computer vision modelsintermediate
• designing metricsintermediate
• implementing metricsintermediate
• measuring model effectivenessintermediate
• measuring model accuracyintermediate
• performing failure analysisintermediate
• preprocessing datasetsintermediate
• cleaning large datasetsintermediate
• optimizing models for performanceintermediate
• optimizing models for scalabilityintermediate
• applying state-of-the-art techniquesintermediate
• collaborating with cross-functional teamsintermediate
• integrating models into productionintermediate

Required Qualifications

• BS or MS and in Data scientist or Computer Vision or related filed (experience)
• Solid background in data science, LLM, machine learning, Computer vision and statistical data analysis (experience)
• Advanced programming skills in data manipulation & processing (SQL & Python preferred) (experience)
• Demonstrated experience in in-depth analysis of machine learning model failures (experience)
• Demonstrated experience using LLM-as-Judge prompt pipeline for Failure analysis (experience)
• Experience crafting, conducting, analyzing, and interpreting experiments and investigations (experience)
• Expertise in data wrangling and developing data visualizations & reporting with toolings such as Tableau, Superset, AWS etc. (experience)

Preferred Qualifications

• Experience managing complex programs in the industry (experience)
• Familiar with machine learning interpretability method (experience)
• Familiar with various foundation models such as CGPT4V, LLAMA, CLIP (experience)
• Detail-oriented to keep track of and understand the workings of complex algorithms (experience)
• Self-motivated, curious, creative and critical thinking capabilities to improve data quality evaluation methods for diverse and complex data annotation programs (experience)
• Outstanding verbal and written communication skills, along with strong collaborative abilities (experience)
• Outstanding communications and presentation abilities, written and verbal to all level of an organization (experience)

Responsibilities

• Our organization manages a diverse array of programs, each presenting a unique set of challenges, however, all programs fundamentally focus on evaluating machine learning algorithms and assessing their quality. In this role, you will work closely with cross-functional teams, leveraging the expertise of domain specialists and project owners while adapting our methodologies as we gain new insights. We aim to support teams in identifying gaps, assessing risks and driving towards impactful outcomes.
• In this role you will:
• - Evaluate Machine Learning Models: Analyze and validate machine learning and computer vision models to ensure they meet performance standards.
• - Develop Metrics: Design and implement metrics to measure the effectiveness and accuracy of models.
• - Failure Analysis: Perform detailed failure analysis to understand model weaknesses and identify areas for improvement.
• - Data Processing: Preprocess and clean large datasets to prepare them for modeling.
• - Model Optimization: Optimize models for performance and scalability, applying state-of-the-art techniques.
• - Collaborate: Work closely with cross-functional teams, including software engineers, product managers, and other data scientists, to integrate models into production.

Tags & Categories