Applied Research Engineer - Multimodal AI
The Video Computer Vision (VCV) organization is a centralized applied research and engineering team developing real-time, on-device Computer Vision and Machine Perception technologies across Apple products. Within VCV, the Multimodal Intelligence team builds next-generation multimodal AI systems that combine large language models, multimodal LLMs, and foundation models to create intelligent systems capable of understanding, reasoning, and acting across language, vision, audio, and tools. We develop multimodal agentic systems deeply integrated into the Apple ecosystem, partnering across hardware, software, and ML teams to deliver advanced AI in real-time, scalable, and privacy-preserving experiences reaching millions of users.
Description
We are seeking an Applied Research Engineer with demonstrated experience in applied machine learning and generative AI. In this role, you'll build multimodal agent systems, translating research ideas into production-ready solutions for Apple products. Your work will encompass building and shipping agentic systems alongside developing evaluation tools and frameworks-understanding limitations, systematically analyzing failure modes, and creating methodologies to improve robustness, safety, and real-world generalization.
Want more jobs like this?
Get jobs in Sunnyvale, CA delivered to your inbox every week.
This role offers the unique opportunity to impact millions of users while working at the intersection of research and production. You'll collaborate with world-class researchers and engineers, access cutting-edge hardware platforms, and solve novel problems in on-device AI that few organizations can address. Your work will directly shape how people interact with multimodal AI in Apple products.
This role spans multiple dimensions of agent development - including context optimization, multi-turn orchestration, tool use, planning, evaluation, robustness analysis, and system optimization. Depending on experience and strengths, candidates may focus on different aspects of the agent lifecycle while contributing to the shared mission of building next-generation multimodal agents","responsibilities":"Design and develop agentic AI systems that reason, plan, and act across tools and modalities
Develop supporting capabilities such as tool-use policies, multi-step reasoning evaluation harnesses, memory optimization, and performance optimization under real-time on-device constraints
Prototype and evaluate novel approaches, combining research exploration with hands-on engineering to translate innovations from concept to production
Collaborate with ML engineers, platform teams, and product groups to adapt research innovations into scalable, reliable solutions meeting Apple's standards for performance, safety, and privacy
Own end-to-end development of agent capabilities, from ideation and experimentation through evaluation, iteration, and integration into Apple products
Preferred Qualifications
PhD with research experience in agentic systems, reasoning, planning, or reinforcement learning
Hands-on experience building agents, including planning, task decomposition, tool use, and multi-step reasoning
Experience with language or multimodal foundation models (training, fine-tuning, context optimization)
Expertise in designing evaluation methodologies for agentic systems: scenario generation, failure analysis, robustness testing, and safety validation
Publication record in top tier venues is a plus (NeurIPS, ICML, ICLR, CVPR, etc)
Minimum Qualifications
MS in Computer Science, Machine Learning, AI, Robotics, or a related field (or equivalent practical experience)
Strong foundation in machine learning and deep learning, including Agentic AI, reasoning, and large-scale models
Demonstrated experience building production systems with LLMs and/or multimodal LLMs
Proficiency in Python and in modern deep learning frameworks (PyTorch preferred)
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .
Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Perks and Benefits
Health and Wellness
Parental Benefits
Work Flexibility
Office Life and Perks
Vacation and Time Off
Financial and Retirement
Professional Development
Diversity and Inclusion
Company Videos
Hear directly from employees about what it is like to work at Apple.