US 11,657,580 B2
Surface aware lens
Andrew James McPhee, Culver City, CA (US); Ebony James Charlton, Los Angeles, CA (US); Samuel Edward Hare, Los Angeles, CA (US); Michael John Evans, Venice, CA (US); Jokubas Dargis, Santa Monica, CA (US); and Ricardo Sanchez-Saez, Santa Monica, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Oct. 19, 2021, as Appl. No. 17/505,370.
Application 17/505,370 is a continuation of application No. 16/922,618, filed on Jul. 7, 2020, granted, now 11,195,338.
Application 16/922,618 is a continuation of application No. 16/283,482, filed on Feb. 22, 2019, granted, now 10,740,978.
Application 16/283,482 is a continuation of application No. 15/863,575, filed on Jan. 5, 2018, granted, now 10,242,503.
Claims priority of provisional application 62/444,218, filed on Jan. 9, 2017.
Prior Publication US 2022/0036660 A1, Feb. 3, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G06T 15/20 (2011.01); G06T 15/60 (2006.01); G06F 3/0346 (2013.01); G06F 3/01 (2006.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06F 3/0346 (2013.01); G06T 15/205 (2013.01); G06T 15/60 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a memory;
a redundant tracking subsystem comprising a set of tracking subsystems, the set of tracking subsystems comprising: a gyroscopic tracking system, a natural feature tracking system, and a simultaneous localization and mapping tracking system; and
at least one hardware processor coupled to the redundant tracking subsystem to perform operations comprising:
assigning a virtual object to a position in three-dimensional space captured within a camera view;
rendering the virtual object to appear at the position in the three-dimensional space within the camera view; and
maintaining, via the redundant tracking subsystem, the virtual object rendered at the position in the three-dimensional space while detecting one or more interruptions to one or more tracking indicia used by the redundant tracking subsystem.