US 11,769,307 B2
Image based tracking in augmented reality systems
Nathan Jurgenson, Venice, CA (US); Linjie Luo, Los Angeles, CA (US); Jonathan M. Rodriguez, II, Los Angeles, CA (US); Rahul Bhupendra Sheth, Los Angeles, CA (US); Jia Li, Marina Del Rey, CA (US); and Xutao Lv, Marina Del Rey, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 25, 2022, as Appl. No. 17/728,553.
Application 17/728,553 is a continuation of application No. 16/913,503, filed on Jun. 26, 2020, granted, now 11,315,331.
Application 16/913,503 is a continuation of application No. 16/438,226, filed on Jun. 11, 2019, granted, now 10,733,802.
Application 16/438,226 is a continuation of application No. 16/136,849, filed on Sep. 20, 2018, granted, now 10,366,543.
Application 16/136,849 is a continuation of application No. 15/830,965, filed on Dec. 4, 2017, granted, now 10,102,680.
Application 15/830,965 is a continuation of application No. 15/591,887, filed on May 10, 2017, granted, now 9,836,890.
Application 15/591,887 is a continuation of application No. 14/954,090, filed on Nov. 30, 2015, granted, now 9,652,896.
Claims priority of provisional application 62/248,706, filed on Oct. 30, 2015.
Prior Publication US 2022/0245907 A1, Aug. 4, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 7/73 (2017.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06T 7/20 (2017.01); G06T 13/80 (2011.01); G06T 19/20 (2011.01); G06T 7/246 (2017.01)
CPC G06T 19/006 (2013.01) [G06F 3/012 (2013.01); G06F 3/04815 (2013.01); G06T 7/20 (2013.01); G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06T 13/80 (2013.01); G06T 19/20 (2013.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06T 2200/04 (2013.01); G06T 2207/30244 (2013.01); G06T 2219/2004 (2013.01); G06V 2201/07 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
obtaining, by a computing system including memory and one or more processors, image data corresponding to an image of an environment, wherein the image includes a building and a graphic and the image is captured by an image sensor;
retrieving, by the one or more processors, building location information describing one or more location points for at least a first building;
processing, using the one or more processors, the image data with respect to the building location information to identify a match between at least a portion of the image that includes the building and one or more location points of the building;
determining, by the one or more processors, alignment information based on the graphic, the alignment information including at least one of position information, elevation information, or size information of the graphic; and
calculating, using the one or more processors, a position estimate of the image sensor based on the alignment information and the match between the at least the portion of the image data that includes the building and the one or more location points of the first building.