US 12,435,996 B2
Field calibration of an augmented reality device
Clemens Birklbauer, Vienna (AT); Georg Halmetschlager-Funek, Vienna (AT); Matthias Kalkgruber, Vienna (AT); Tiago Miguel Pereira Torres, Vienna (AT); and Simon Schreiberhuber, Vienna (AT)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Sep. 28, 2023, as Appl. No. 18/477,297.
Prior Publication US 2025/0109966 A1, Apr. 3, 2025
Int. Cl. G01C 25/00 (2006.01); G01C 21/00 (2006.01); G01C 21/16 (2006.01); G06T 7/80 (2017.01); G06T 19/00 (2011.01)
CPC G01C 25/00 (2013.01) [G01C 21/005 (2013.01); G01C 21/1656 (2020.08); G06T 7/80 (2017.01); G06T 7/85 (2017.01); G06T 19/006 (2013.01)] 18 Claims
OG exemplary drawing
 
1. An augmented reality (AR) device configured to perform a field-based recalibration procedure, the AR device comprising:
a display;
a processor;
two or more image sensors;
an Inertial Measurement Unit (IMU); and
a memory storing instructions thereon, which, when executed by the processor, cause the AR device to perform operations comprising:
determining the AR device is operating in a state with a high likelihood of having an accurate factory calibration;
in response to determining the AR device is operating in the state, i) generating ground truth map data for a real-world environment, and ii) storing the ground truth map data for the real-world environment;
subsequent to storing the ground truth map data for the real-world environment:
generating map data for the real-world environment by processing images obtained from the image sensors and motion data from the IMU;
detecting a possible calibration error by comparing the map data for the real-world environment with the ground truth map data for the real-world environment that was previously generated by the AR device;
in response to detecting the possible calibration error, evaluating a rule to determine that a recalibration procedure is to be executed; and
executing the recalibration procedure by generating visual cues and displaying the visual cues via the display, the visual cues prompting a user of the AR device to traverse a path in the real-world environment, and to look in specific directions while traversing the path, during the recalibration procedure.