Machine Learning Validation Automation Engineer

We are the Product Systems Quality team and we are looking for a highly motivated and experienced automation engineer with a passion for delivering robust, inclusive, and state-of-the-art Computer Vision and Machine Learning algorithms in Apple's next generation of products. You'll enjoy working on a team of quality engineers with a diverse group of backgrounds as we refine the model pipelines that power Apple's trademark simple and intuitive user experience.

Come be a part of our team and use both creativity and technical expertise to bring experiences to life that our customers love!

Description

We are seeking an experienced Automation Engineer to lead the design and implementation of data collection and evaluation pipelines for Apple's ML systems. In this role, you will design, develop and maintain automation frameworks and validation pipelines for machine learning models.

Your work will require close partnership with algorithm development teams to build tools for analyzing and visualizing data, evaluate and represent the true customer experience, design and implement experiments for engineering studies. You will develop and execute validation strategies to ensure the models meet accuracy & reliability requirements as well as create visualization for comparing model validation results across configurations to enable root cause analysis for failures. You'll have opportunity to take ownership of issues, drive them to resolution and continuously improve tests and processes with a drive towards innovation and automation.

You'll be working through every step of the product development cycle and will help make Apple products more reliable, flexible, and easy to use.

Preferred Qualifications

5 or more years of ML industry experience, including time spent debugging or improving deployed models

Experience with analytical tools such as Jupyter, Pandas, NumPy, Matplotlib

Experience in training models using frameworks like PyTorch, TensorFlow

Data analysis, visualization, and reporting experience with tools such as Tableau, or Splunk

Minimum Qualifications

Bachelor's degree or equivalent in Computer Science, Machine Learning or related field

A minimum of 3 years of hands-on industry experience developing or validating ML/AI systems

Proficiency in Python with strong background in test automation and test infrastructure design

Experience in working with large datasets for testing products utilizing computer vision, machine learning

Ability to communicate effectively and collaborate with partner teams

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .