US 11,748,954 B2
Tracking an augmented reality device
Qi Pan, London (GB); Edward James Rosten, London (GB); Andrew Tristan Spek, London (GB); and Supannee Tanathong, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Oct. 29, 2020, as Appl. No. 17/83,722.
Claims priority of provisional application 62/704,881, filed on Jun. 1, 2020.
Prior Publication US 2021/0375054 A1, Dec. 2, 2021
Int. Cl. G06T 19/00 (2011.01); G06T 7/70 (2017.01)
CPC G06T 19/006 (2013.01) [G06T 7/70 (2017.01)] 20 Claims
OG exemplary drawing
 
1. A method of operating an augmented reality device, performed by one or more processors, comprising:
determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose;
receiving an inertial measurement unit (IMU) pose determined from data generated by an inertial measurement unit including motion sensors;
determining a transformation between the pose estimate and the IMU pose;
applying the transformation to the pose estimate to generate a pose update; and
applying media content to a position within an image, the position being based on the pose update.