US 11,698,708 B2
Systems and methods for augmented reality with precise tracking
Brandon Phillip Berquam, South Pasadena, CA (US); Ciara Rayne Staggs, Oak View, CA (US); Joshua James Pendrick, Hermosa Beach, CA (US); and Andrew Tsui Jung, Los Angeles, CA (US)
Assigned to Rypplzz, Inc., Hermosa Beach, CA (US)
Filed by Rypplzz, Inc., Hermosa Beach, CA (US)
Filed on May 3, 2022, as Appl. No. 17/661,811.
Application 17/661,811 is a continuation of application No. 17/158,425, filed on Jan. 26, 2021, granted, now 11,327,629.
Application 17/158,425 is a continuation of application No. 16/775,692, filed on Jan. 29, 2020, granted, now 10,908,771, issued on Feb. 2, 2021.
Claims priority of provisional application 62/799,614, filed on Jan. 31, 2019.
Prior Publication US 2022/0365656 A1, Nov. 17, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/04815 (2022.01); G06T 19/00 (2011.01); G06F 3/04845 (2022.01); G06F 3/01 (2006.01)
CPC G06F 3/04815 (2013.01) [G06F 3/011 (2013.01); G06F 3/04845 (2013.01); G06T 19/006 (2013.01); G06T 2200/24 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computer system configured to provide augmented reality experiences, the computer system comprising:
one or more processing devices;
a network interface;
non-transitory memory that stores instructions that when executed by the one or more processing devices are configured to cause the computer system to perform operations comprising:
accessing a model, comprising a point cloud, of a first physical environment;
converting points in the point cloud to an array of adjacent values defining respective logical addresses;
receiving a mesh definition of a three dimensional mesh using the network interface from a first terminal via a user interface, the three dimensional mesh comprising a plurality of mesh cells, wherein a given mesh cell is associated with a logical address converted from a corresponding point in the point cloud;
associating the mesh definition of the three dimensional mesh with the model of the first physical environment, wherein a given mesh cell corresponds to a specific location in the first physical environment;
enabling content and an action to be associated with a given mesh cell to define a data cube;
enabling the data cube, defined using the content and action, to be dragged from a first mesh location to a second mesh location;
receiving, in real time, tracking data corresponding to movement of a first user in the first physical environment;
comparing the tracking data of the first user with mesh cell locations associated with corresponding logical addresses;
based at least on the comparison of the tracking data of the first user with mesh cell locations associated with corresponding logical addresses, identifying one or more matching mesh cells;
using logical addresses, converted from points in the point cloud, associated with the one or more matching mesh cells, to identify associated content, actions, and/or rules;
using the identified associated content, actions, and/or rules associated with the one or more matching mesh cells, causing augmented reality content to be rendered by a device in proximity to the first user, the augmented reality content displayed in association with a view of a physical space.