Research Scientist Intern, Multimodal AI for Human-Computer Interaction (PhD)

Meta Reality Labs Research is seeking a highly motivated and skilled research intern to join our team in developing cutting-edge technologies for AR glasses. Our mission is to apply cutting-edge machine learning and AI methods to problems in AR/VR input and interaction, with a focus on collaboration with domain experts.As a research intern, you will work on projects that span modeling, human-in-the-loop experimentation, and design of novel sensors and tracking algorithms. You will have access to cutting-edge technology, resources, and testing facilities, and will collaborate with a diverse and interdisciplinary team of researchers and engineers.Your primary focus will be on developing novel, robust, sensor processing algorithms for wearables, using techniques such as self-supervised learning, robust decoding of biometric signals, multi-modal sensor-fusion and LLM finetuning techniques. Your work will be at the intersection of signal processing, machine learning, and human-computer interaction, and you will have the opportunity to work with world-class researchers, collaborators and mentors in these fields.Candidates will work with researchers to help enable the following research disciplines: -Multi-modal AI for contextual understanding -Multi-modal AI for human computer interactionThis position has a preference of sixteen (16) consecutive weeks up to twenty-four (24) weeks long and we have various start dates throughout the year.

• Plan and execute cutting-edge research and design of novel adaptive algorithms for various sensory models.
• Implement signal processing, classification, fusion, and confounder mitigation algorithms to develop systems that are robust, efficient, easily tunable, and yield seamless interactions.
• Troubleshoot, debug, and upgrade existing software, contribute to code documentation and maintenance of the analysis pipeline.
• Collaborate with the larger research team, present and share results with key stakeholders.
• Advance the state of the art (SOTA) in sample-efficient modeling for understanding human cognition and action writ large.
• Use SOTA models to deliver advances in downstream experiments or demos - it has to work in real life.
• Successful internships may also lead to publishable outcomes in top-tier journals or at leading international conferences.

• Currently has, or is in the process of obtaining, a PhD in Computer Science, Electrical or Computer Engineering, Robotics, or relevant technical field
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
• 3+ years of experience with scientific programming languages such as Python or C++
• Experience with online and offline signal processing of biological time series data and sensor-fusion techniques
• Research experience involving defining problems, exploring solutions, and analyzing and presenting results

• Two or more first-authored publications in top ML or HCI conferences/journals
• Familiarity with AR/VR technologies and literature
• Experience with biometric or biosignal modeling for real-time interactive scenarios (e.g., gesture recognition, action recognition)
• Experience with machine learning and related frameworks, such as sklearn or Pytorch
• At least one publication focused primarily on modeling
• Experience working directly with domain experts in non-ML fields, for example mechanical engineers or designers, neuroscientists, physicists, etc
• Experience writing research software used by others, for example as part of an academic collaboration, an open-source project, or equivalent
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ICML, NeurIPS, ICLR, KDD, CHI, UIST or similar
• Experience working and communicating cross functionally in a team environment
• Intent to return to a degree program after the completion of the internship/co-op
• Availability for minimum 16 consecutive week internship