US 12,229,905 B2
Registration for augmented reality system for viewing an event
Sankar Jayaram, Los Gatos, CA (US); Wayne O. Cochran, Ridgefield, WA (US); John Harrison, Hillsboro, OR (US); Timothy P. Heidmann, Los Altos, CA (US); and John Buddy Scott, Lawrenceville, GA (US)
Assigned to Quintar, Inc., Santa Clara, CA (US)
Filed by Quintar, Inc., Santa Clara, CA (US)
Filed on Mar. 28, 2023, as Appl. No. 18/191,781.
Application 18/191,781 is a continuation of application No. 17/242,267, filed on Apr. 27, 2021, granted, now 11,657,578.
Claims priority of provisional application 63/159,870, filed on Mar. 11, 2021.
Prior Publication US 2023/0237747 A1, Jul. 27, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G06T 7/33 (2017.01); G06T 7/73 (2017.01)
CPC G06T 19/006 (2013.01) [G06T 7/33 (2017.01); G06T 7/73 (2017.01); G06T 2207/30204 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A mobile device, comprising:
a camera configured to generate image data;
a display configured to display the generated image data;
one or more sensors configured to generate, in an internal coordinate system for the mobile device, corresponding image metadata for the image data;
one or more interfaces configured to exchange data with one or more servers;
a memory; and
one or more processing circuits configured to:
transmit over the one or more interfaces the image data and the corresponding image metadata to one or more servers;
subsequent to transmitting the image data and the corresponding image metadata, receive from the one or more servers over the one or more interfaces a transformation between the internal coordinate system of the mobile device and a real world coordinate system and graphics to be displayed by the display over a view of a venue generated by the camera, the graphics to be displayed specified by location and orientation in the real world coordinate system;
convert the graphics into the mobile device's internal coordinate system based on the transformation between the mobile device's internal coordinate system and the real world coordinate system;
present by the display of the graphics over the view of the venue;
receive over the one or more interfaces from the one or more servers and store in the memory a set of template images, including a set of tracking points within each of the template images, the tracking points configured to allow the mobile device to track an accuracy of the transformation between the mobile device's internal coordinate system and the real world coordinate system, and
perform a comparison of the tracking points within a template image with a view of the venue obtained by the camera as transformed by the transformation and update the transformation based on the comparison.