Job Description

Locations

• Cupertino, California, United States 95014

Salary

Skills Required

• driving product impact via measurement and evaluationintermediate
• principled evaluationintermediate
• rigorous use of dataintermediate
• improve search qualityintermediate
• guide feature development with dataintermediate
• research and develop evaluation methodsintermediate
• work with large complex data setsintermediate
• solve difficult non-routine analysis problemsintermediate
• applying advanced analytical methodsintermediate
• prompt engineeringintermediate
• building LLMs as judgesintermediate
• data collectionintermediate
• quality controlintermediate
• requirements specificationintermediate
• data processingintermediate
• data presentationsintermediate
• build and prototype analysis pipelinesintermediate
• develop comprehensive knowledge of product data structures and metricsintermediate
• advocating for changesintermediate
• partner with product engineering teamsintermediate
• core machine learning algorithmsintermediate
• user experience evaluationsintermediate
• innovationintermediate

Required Qualifications

• 5 years of relevant work experience. Advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar quantitative field. (experience, 5 years)
• Proficiency in data science, machine learning, and analytics, including statistical data analysis. Experience crafting, conducting, analyzing, and interpreting experiments and investigations, especially on data quality, evaluation and risk assessment. (experience)
• Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala). (experience)
• Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data. Strong communication skills and the ability to naturally explain difficult technical topics (especially causal topics) to everyone from data scientists to engineers to business partners. (experience)

Preferred Qualifications

• Proven ability to collaborate effectively across functions and work well within a team. (experience)
• Capable of driving projects of varying sizes and scopes - some will take months and some weeks — and you will need to know when to dive deep. (experience)
• Worked with methods that address accuracy and variability in human annotation data. (experience)
• Ability to learn new technology and skills to accommodate changing working requirements. (experience)

Responsibilities

• Research and develop evaluation methods to improve the quality of Apple user facing products, such as Siri and Apple Intelligence.
• Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that product engineering will use every day.
• Work with large, complex data sets.
• Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed, including prompt engineering and building LLMs as judges.
• Conduct analysis that includes data collection and quality control, requirements specification, processing and presentations. Build and prototype analysis pipelines iteratively to provide insights at scale.
• Develop comprehensive knowledge of product data structures and metrics, advocating for changes where needed for product development.
• Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations.
• You should be passionate about building outstanding products. This position involves a wide variety of skills and innovation.

Tags & Categories