Research Scientist Intern, Multimodal Behavioral AI (PhD)

Meta Reality Labs (Redmond, WA) is looking for exceptional interns to solve complex challenges in behavioral inference from sparse information. Our world-class team of researchers in Reality Labs Research leverage multimodal, egocentric data (such as from Project Aria) and cutting edge machine learning to deliver robust, efficient models that serve everyone. Our research provides core building blocks to unlock comfortable, intuitive, and helpful Wearable AI, empowering everyone to harness the superpowers of this emerging technology in their daily lives.

We welcome PhD students in computer science, machine learning, robotics, computational neuroscience, or related fields. In particular, we are looking for candidates with experience in multimodal inference of complex systems, often with limited or ambiguous ground truth. We welcome students with a passion for working in a strongly collaborative team that spans research across human behavior, robust algorithms, and systems prototyping and optimization.

Our team at Meta Reality Labs offers twelve (12) to twenty four (24) week long internships and we have various start dates throughout the year. Some projects may require a minimum of sixteen (16) consecutive weeks.

Responsibilities

Using data from wearable devices, develop novel state-of-the-art AI algorithms to infer human behavior patterns that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, physiological sensing, gestures, or vocal cues. Develop data collection strategies, benchmarks, and metrics to validate and improve efficiency, scalability, and stability of these models. Collaborate with researchers and engineers across diverse disciplines through all stages of project development. Contribute to research that can eventually be applied to Meta products and services and run on billions of media items every day. Regular communication of research agenda, progress and results. Publish research results in top-tier journals and at leading international conferences.

Qualifications

Currently has or is in the process of obtaining a PhD in the field of Computer Science, Machine Learning, Robotics, Neuroscience, or a related field Programming experience in Python and with deep learning frameworks like PyTorch Deep learning experience with modern generative AI frameworks Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment Past experience with interdisciplinary, cross-group and cross-culture collaboration Extensive experience solving analytical problems using quantitative approaches Comfort analyzing high-volume natural language and multimodal data from varying sources Experience with optimization of machine learning algorithms with limited data and on constrained hardware Experience communicating complex research in a clear, precise, and actionable manner Proven track record of achieving results as demonstrated by grants, fellowships, patents, and/or first-authored publications at workshops or top AI conferences such as CVPR, NeurIPS, CHI, ICLR, ACL, EMNLP or similar journals Intent to return to degree-program after the completion of the internship