US 12,423,924 B2
Methods for calibrating augmented reality scenes
Neil Leonard Padgett, Toronto (CA); Russ Maschmeyer, Berkeley, CA (US); Eric Andrew Florenzano, San Francisco, CA (US); Brennan Letkeman, Calgary (CA); Andrew Nhat-Nam Ngo, Toronto (CA); Hettige Ray Perera Jayatunga, Toronto (CA); James Lepp, Ottawa (CA); and Diego Macario Bello, Montreal (CA)
Assigned to Shopify Inc., Ottawa (CA)
Filed by Shopify Inc., Ottawa (CA)
Filed on Dec. 16, 2022, as Appl. No. 18/082,706.
Claims priority of provisional application 63/405,167, filed on Sep. 9, 2022.
Prior Publication US 2024/0087251 A1, Mar. 14, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 3/04845 (2022.01); G06F 3/0486 (2013.01); G06T 3/14 (2024.01); G06T 7/73 (2017.01)
CPC G06T 19/006 (2013.01) [G06F 3/017 (2013.01); G06T 3/14 (2024.01); G06T 7/73 (2017.01); G06F 3/04845 (2013.01); G06F 3/0486 (2013.01); G06T 2207/30204 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
determining a first position of a real display device in a real-world environment;
selectively causing to be displayed, on a displayable area associated with the real display device, a software-generated virtual visual marker for use in positional synchronization of an AR scene, wherein the virtual visual marker encodes a unique identifier of the real display device and at least one of location, orientation, or scale of the virtual visual marker relative to the real display device and wherein the virtual visual marker is caused to be displayed in response to detecting a calibration drift;
receiving a request to display virtual information on a virtual display at a second relative position with respect to the first position in an AR version of the real-world environment;
responsive to receiving the request:
determining a displayable area of the virtual display in the AR scene, wherein determining the displayable area comprises:
detecting the virtual visual marker in image data depicting the real display device; and
causing the displayable area of the virtual display to be anchored on the real display device based on the detected virtual visual marker; and
causing the virtual information to be overlaid on the displayable area in the AR version of the real-world environment.