Postdoctoral Research Scientist, Applied Perception Science (PhD)

Vision science and visual computing is at the center of our research, as it informs our work in displays, optics, rendering pipeline, and practically everything in the AR/VR system. As a Research Scientist in the Applied Perception Science team for Reality Labs Meta, you will be tackling the scientific challenges that define cutting-edge augmented & virtual reality, addressing heretofore unanswered questions in vision science, visual computing, displays, and optics research. This involves conducting research at the intersection of basic and applied science, as it informs our research directions and identifies opportunities for revolutions in our metrics and experiences. We are committed to a whole-system, multidisciplinary approach to perception research and have the opportunity to both collaborate with academic institutions as well as publish and disseminate our work. Projects take advantage of internal resources in mechanical, electrical, optical, and software engineering, allowing us to confront scientific and product engineering challenges which cannot necessarily be answered with existing products or prototypes. We are seeking a Research Scientist whose expertise lies at the intersection of computer graphics, image processing, and applied perception. The ideal candidate will be passionate about conducting research that guides development of perceptually motivated metrics and graphics techniques for VR/AR.

• Conduct research in bringing perceptual insights to graphics pipelines, with special emphasis on efficient real-time on-device methods.
• Derive metrics to quantify visual quality and estimate the magnitude of perceptual artifacts and gauge cost/benefit trade-offs of visual computing techniques.
• Derive novel experimental and/or modeling approaches to assess the impact of luminance, color, spatial and temporal properties impact visual quality in AR/VR.
• Work with cross-functional partners in research and product development to understand and prioritize perceptual needs.
• Employ existing knowledge of human sensory encoding and display quality metrics to help guide engineering efforts towards effective display, optical, and rendering solutions.
• Detect & identify possible perceptual artifacts that can arise from novel prototypical displays from architectural specifications and proposals.
• Communicate the findings from modeling, psychophysics, & empirical experiments to help set target requirements for display systems in AR/VR.

• Currently has, or is in the process of obtaining, a PhD degree in Vision Science, Perceptual Psychology, Optics, Computational Imaging, Biomedical Engineering, or a related field with an emphasis on perceptual modeling, psychophysics, and/or metrics evaluating perceptual performance or a related field.
• Experienc working with 3D graphics methods and familiar with standard pipelines.
• Solid knowledge of computational metrics used in visual computing, such as image and video difference metrics.
• Familiar with state-of-the-art in perceptual graphics, including practical experience working with perceptually-inspired techniques in 3D graphics pipelines.
• Experience with perceptually-motivated algorithm design (e.g. foveated rendering, BRDF modeling, shading, HDR/tone mapping, etc.)
• Knowledge of how display characteristics interact with visual encoding processes in the generation of visual artifacts.
• Experience with research publicized in high-impact journals and international conference presentations or publications.
• Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.

• Academic background in computer science, computer graphics, vision science, or a related field.
• Extensive experience in 3D graphics, using research and/or commercially-available tools (e.g. Mitsuba, Unity, Maya)
• Experience working on the evaluation and engineering of display electronics and controllers. Knowledge of standard image quality metrics, and deriving new metrics for novel environments and/or display architectures.
• Knowledge of the complete image processing pipeline, from capture through reproduction through professional experience, publications and/or academic training.
• Industry experience conducting research investigating perceptual issues with displays, or visual processing.
• 3+ years experience in Vision Science, Perceptual Psychology, Optics, Computational Imaging, Biomedical Engineering, or a related field with an emphasis on perceptual modeling, psychophysics, and/or metrics evaluating perceptual performance.
• 3+ years experience in hardware design and prototyping hardware systems to simulate issues with proposed and novel display and hardware architecture. Experience in working on team that ships product.
• Experience working and communicating cross-functionally in a team environment.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences that are relevant to the position.