US 11,657,578 B2
Registration for augmented reality system for viewing an event
Sankar Jayaram, Los Gatos, CA (US); Wayne O. Cochran, Ridgefield, WA (US); John Harrison, Hillsboro, OR (US); Timothy P. Heidmann, Los Altos, CA (US); and John Buddy Scott, Lawrenceville, GA (US)
Assigned to Quintar, Inc., Santa Clara, CA (US)
Filed by Quintar, Inc., Santa Clara, CA (US)
Filed on Apr. 27, 2021, as Appl. No. 17/242,267.
Claims priority of provisional application 63/159,870, filed on Mar. 11, 2021.
Prior Publication US 2022/0292783 A1, Sep. 15, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 7/73 (2017.01); G06T 7/33 (2017.01)
CPC G06T 19/006 (2013.01) [G06T 7/33 (2017.01); G06T 7/73 (2017.01); G06T 2207/30204 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method, comprising:
retrieving by a server from one or more databases point features of a venue for an event in a real world coordinate system, a location for each of the point features in the real word coordinate system derived from a survey of the venue;
retrieving by the server from the one or more databases locations of a set of fiducials features for the venue in the real world coordinate system;
receiving by the server of image data and image metadata from a mobile device, the image metadata including information on the mobile device's location and orientation within the venue in an internal coordinate system of the mobile device;
generating by the server of a transformation between the mobile device's internal coordinate system and the real world coordinate system from the image data and image metadata received from the mobile device, from locations of the point features of the venue in the real world coordinate system, and from the locations of the set of fiducials features in the real world coordinate system;
generating by the server from the image data and from the locations of point features of the venue a set of template images, including a set of tracking points within each of the template images, for the mobile device, the set template images and sets of tracking points configured to be reference images and reference points for the mobile device to track an accuracy of the transformation between the mobile device's internal coordinate system and the real world coordinate system;
transmitting from the server to the mobile device the transformation between the mobile device's coordinate system and the real world coordinate system;
transmitting from the server to the mobile device the set of template images and the set of tracking points within each of the template images;
receiving at the mobile device the transformation between the mobile device's internal coordinate system and the real world coordinate system;
receiving at the mobile device the set of template images and the set of tracking points within each of the template images;
obtaining by the mobile device of one or more views of the venue in the mobile device's internal coordinate system;
performing one or more comparisons by the mobile device of the set of tracking points within one or more of the template images with the view of the venue obtained by the mobile device as transformed by the transformation between the mobile device's internal coordinate system and the real world coordinate system; and
updating by the mobile device of the transformation between the mobile device's internal coordinate system and the real world coordinate system based on the one or more comparisons.