Research Scientist Intern, Neural Rendering and Split-Compute Systems (PhD)

The Meta Reality Labs Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. The focus of our team is on computer graphics with primary research on the efficient synthesis of high-quality images for AR/VR systems. Our current research areas include custom graphics hardware, rendering algorithms for AR/VR, such as ray casting and neural rendering, perceptual aware rendering, neural compression, split-compute graphics systems, and generative AI for 3D graphics. For the internship position, we are looking for Ph.D. students to investigate various core research problems for neural rendering and how we can partially offload graphics compute to cloud or companion devices. Partner with expert research scientists and engineers to build cutting-edge prototypes and create the technology that makes AR and VR universal.Meta Reality Labs offers internships ranging from twelve (12) to twenty-four (24) week periods. We encourage submitting papers to high-ranked computer graphics conferences and journals based on the results of the internship.

Research Scientist Intern, Neural Rendering and Split-Compute Systems (PhD) Responsibilities:

• Design and develop novel split-compute graphics systems to enable and prototype novel AR/VR experiences.
• Deliver the state-of-the-art research outcome to push the boundary of neural rendering research.
• Accelerate development of one or more graphics-related research projects.
• Conceive and develop novel rendering solutions from idea to prototypes.
• Implement proof-of-concept technical prototypes and systems that re-define the state-of-the-art visual experiences in virtual and augmented reality.
• Develop highly optimized real-time solutions with GPU rendering, ML applied to graphics, and compute.
• Learn constantly, educate others, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR/VR problem solving.
• Collaborate with cross-disciplinary research and engineering teams.

• Currently has, or is in the process of obtaining, a PhD degree in the field of Computer Graphics, Computer Vision, Machine Learning or related field
• 3+ years of experience in C/C++, Python or ML programming
• Familiar with at least one popular deep learning framework, such as PyTorch
• Familiar with at least one graphics API, such as Vulkan
• In-depth knowledge on image formation model and graphics rendering pipeline
• Deep understanding and hands-on experiences in one or more of the following: neural rendering / generative 3D / real-time game engine development / real-time video compression / remote rendering systems / ML-based graphics rendering related research
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

• Graphics experience with good understanding of key rendering concepts, such as lighting and shading, PBR materials, ray tracing, differentiable rendering, or related work
• Deep understanding and hands-on experiences in one or more of the following: GPU design/optimization, real-time ray tracing or rasterization solutions, modern compression algorithms, network systems and bandwidth reduction, differentiable/inverse rendering
• Experience with various types of 3D geometry like polygons, curves, subdivision surfaces, displacement mapping, and signed distance fields
• Experience with geometry compression
• Experience in research or advanced development
• Experience in modern machine learning methods with hands-on implementation experience
• Demonstrated software engineering experience within a complex codebase via an internship, work experience, coding competitions, or widely used contributions to open source repositories such as GitHub
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as ACM SIGGRAPH/SIGGRAPH Asia, High Performance Graphics (HPG), ACM SIGGRAPH Symposium on Interactive 3D and Graphics (I3D), Eurographics Symposium on Rendering (EGSR), CVPR/ICCV/ECCV, NeurIPS, etc
• Intent to return to a degree-program after the completion of the internship/co-op