1,856 jobs for "Data Analysis Manager"

Algorithm Evaluation Manager

At Apple - Sunnyvale

Posted on Oct 16

View job Apply on company site

Data Scientist Senior--People Analytics & Quantitative Insights

At PNC - Pittsburgh

Posted on Oct 16

View job Apply on company site

CDN Capacity & Infrastructure Manager, Infrastructure Services

At Apple - Denver

Posted on Oct 11

View job Apply on company site

Business Manager - Talent, Development, and Org Insights Intelligence Analyst

At Capital One - McLean · Richmond

Posted on Oct 11

View job Apply on company site

Software Engineering Manager - Strategic Data Solutions.

At Apple - Cork

Posted on Oct 10

View job Apply on company site

AI Product Operations Associate

At Tradeweb - New York

Posted on Nov 5

View job Apply on company site

Sales Manager - Columbus, OH

At Altria Group, Inc. - Columbus

Posted on Nov 8

View job Apply on company site

Senior Product Manager - AI & Data Security

At Forcepoint - Remote / Flexible

Posted on Oct 26

View job Apply on company site

Data Engineering Manager

At Trupanion - Seattle

Posted on Nov 4

View job Apply on company site

Sr Pricing Analyst

At Sonepar USA Inc - Irving

Posted on Oct 16

View job Apply on company site

Product Marketing Manager

At Pluralsight - Remote / Flexible

Posted on Oct 20

View job Apply on company site

Lead Product Manager - Marketing Attribution & Performance

At UKG - Remote / Flexible

Posted on Oct 26

View job Apply on company site

Area Sales Manager

At Taylor Morrison - Maitland

Posted on Oct 14

View job Apply on company site

Senior Manager, Sales Analytics

At CarGurus - Boston

Posted on Nov 4

View job Apply on company site

Manager, Quality Systems

At BD - Bengaluru

Posted on Nov 4

View job Apply on company site

Manager, Total Cost of Care

At Healthfirst - Hybrid

Posted on Nov 3

View job Apply on company site

Concur System Admin Analyst III

At Waters - Milford

Posted on Oct 29

View job Apply on company site

Quality Control Manager - Asphalt

At CRH - Dunbar

Posted on Oct 9

View job Apply on company site

GameOps Manager

At Aristocrat - Gdańsk

Posted on Nov 7

View job Apply on company site

Embedded Systems Engineer

At Aptiv - Carmel

Posted on Oct 29

View job Apply on company site

Apple

Algorithm Evaluation Manager

Sunnyvale, CA$206,200 – $356,400Posted 22 days ago

Apply on company site View full job

We are looking for an experienced and highly motivated Engineering Manager to lead a dynamic team focused on machine learning algorithms or Large Language Model (LM) evaluation. In this role, you will guide a team responsible for the critical data and evaluation pipelines that ensure our models are accurate, robust, and performant. The ideal candidate will bring a strong mix of technical leadership, expertise in data curation and annotation processes, and deep analytical skills. You will collaborate closely with cross-functional research and engineering teams, requiring exceptional communication and strategic thinking.

Description

As the Engineering Manager for this team, you will be at the forefront of our AI/ML development lifecycle. Your day-to-day responsibilities will include:

- Team Leadership: Lead, mentor, and grow a team of engineers and data specialists. Foster a culture of innovation, rigorous analysis, and continuous learning.

- Evaluation Strategy: Define and execute the evaluation strategy for both CV and LM models. Build robust, scalable evaluation pipelines that accurately reflect real-world performance.

- Data Pipeline Management: Oversee the end-to-end data lifecycle. This includes establishing data curation guidelines, managing data quality, and optimizing large-scale annotation workflows with external vendors or internal teams.

- Analytical Deep Dives: Guide the team in performing rigorous data analysis to troubleshoot model regressions, uncover data quality issues, and identify opportunities for algorithmic improvements.

- Strategic Alignment: Act as the primary point of contact for your team, communicating progress, bottlenecks, and strategic data needs to leadership and partner teams.

Preferred Qualifications

Advanced Degree: PhD in Computer Science, Machine Learning, or a related field.

Deep Domain Knowledge: Expertise in both Computer Vision (CV) algorithms and Large Language Model (LM) evaluation methodologies (e.g., RLHF, prompt evaluation).

Scale & Operations: Experience scaling large data operations, managing complex annotation workflows, and working directly with external data vendors.

Technical Stack: Familiarity with Python, SQL, and ML frameworks (e.g., PyTorch) to effectively review technical work and guide engineering decisions.

Cross-Functional Leadership: Demonstrated ability to drive strategic alignment across downstream product teams, ML researchers, and platform engineers in a highly matrixed environment.

Minimum Qualifications

Education & Experience: BS and a minimum of 10 years relevant industry experience

Management Experience: 2+ years of direct people management experience, with a track record of hiring, mentoring, and leading high-performing technical teams.

Domain Expertise: Proven experience in model evaluation, benchmarking, and A/B testing methodologies for machine learning models (Computer Vision or Foundation Models).

Inference Infrastructure: Familiarity with the design and architecture of machine learning inference pipelines and underlying infrastructure.

Data & Annotation: Hands-on experience designing and managing data curation strategies and human-in-the-loop annotation processes.

Data Analysis: Strong analytical skills with the ability to dive deep into datasets to identify trends, biases, and areas for model improvement.

Communication: Excellent verbal and written communication skills, with the ability to translate complex technical concepts to both technical and non-technical stakeholders.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $206,200 and $356,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology

View company profile