Project Aria: A New Tool for Egocentric Multi-Modal AI Research

• DOI: 10.48550/arxiv.2308.13561
• Publication Date: 2023-01-01
• Authors: Kiran Somasundaram; Jing Dong; Huixuan Tang; Julian Straub; Mingfei Yan; Michael Goesele; Jakob Julian Engel; Renzo De Nardi; Richard Newcombe
• Keywords: Wearable Technology

Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These will need to be all-day wearable in a socially acceptable form-factor support always available, context-aware personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, recording streaming device with goal foster accelerate research this area. In paper, we describe hardware including its sensor configuration corresponding software tools that enable processing of such data.