US 12,067,683 B2
Location persistent augmented reality object and annotation placement
Ryan R. Fink, Vancouver, WA (US); and Sean M. Adkinson, North Plains, OR (US)
Assigned to STREEM, LLC, Portland, OR (US)
Filed by STREEM, INC., Portland, OR (US)
Filed on Sep. 13, 2019, as Appl. No. 16/570,674.
Claims priority of provisional application 62/731,664, filed on Sep. 14, 2018.
Prior Publication US 2020/0090409 A1, Mar. 19, 2020
Int. Cl. G06T 19/00 (2011.01); G06T 7/50 (2017.01)
CPC G06T 19/006 (2013.01) [G06T 7/50 (2017.01); G06T 2200/24 (2013.01); G06T 2207/10028 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, from a first device by a server at a first time, first location data and spatial position data associated with a device capturing a first image at a geographic location, the first location data comprised of a first geographic location data and a first 3D point cloud calculated for the first image, the first 3D point cloud including first depth data;
receiving, by the server at the first time, an augmented reality (AR) object placed within the first image by reference to the first 3D point cloud;
determining a first fingerprint of the location based in part on a plurality of objects detected within the first image and a plurality of anchor points identified in the plurality of detected objects within the first image;
storing, by the server, the AR object, the first location data, the first fingerprint of the location, and spatial position data associated with the first image;
receiving, from a second device by the server at a second time, second location data associated with a second image, the second location data comprised of a second geographic location data and a second 3D point cloud calculated for the second image, the second 3D point cloud including second depth data;
determining, when the second geographic location data indicates the second device is within a predetermined distance to the geographic location as indicated by the first geographic location data, a second fingerprint of the location based in part on a plurality of objects detected within the second image and a plurality of anchor points identified in the plurality of detected objects within the second image;
correlating the first location data with the second location data, wherein correlating the first location data with the second location data comprises comparing the first fingerprint with the second fingerprint, comparing the first fingerprint with the second fingerprint comprising determining when at least a predetermined number of the plurality of anchor points within the first image and the plurality of objects detected within the first image matches corresponding anchor points within the plurality of anchor points within the second image and corresponding objects within the plurality of objects detected within the second image; and
transmitting, by the server at a second time, the AR object when the first and second fingerprints are correlated.