US 12,412,350 B2
Systems and methods for editing content items in augmented reality
Russ Maschmeyer, Berkeley, CA (US); Eric Andrew Florenzano, San Francisco, CA (US); Brennan Letkeman, Calgary (CA); Diego Macario Bello, Montreal (CA); and Daniel Beauchamp, Toronto (CA)
Assigned to Shopify Inc., Ottawa (CA)
Filed by Shopify Inc., Ottawa (CA)
Filed on Nov. 28, 2022, as Appl. No. 17/994,752.
Claims priority of provisional application 63/405,993, filed on Sep. 13, 2022.
Prior Publication US 2024/0087267 A1, Mar. 14, 2024
Int. Cl. G06T 19/20 (2011.01); G06F 3/04815 (2022.01); G06F 3/04845 (2022.01); G06T 11/00 (2006.01); G06T 19/00 (2011.01)
CPC G06T 19/20 (2013.01) [G06F 3/04815 (2013.01); G06F 3/04845 (2013.01); G06T 11/00 (2013.01); G06T 19/006 (2013.01); G06T 2200/24 (2013.01); G06T 2210/32 (2013.01); G06T 2219/2004 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
receiving a user request to edit a first two-dimensional (2D) image that is displayed on a first graphical user interface, the first 2D image depicting a product;
in response to receiving the user request to edit the first 2D image:
presenting, via an augmented reality (AR) device, an AR scene that includes a virtual 3D representation of the product and a view of the first graphical user interface;
monitoring user interactions with the virtual 3D representation of the product based on detected gestures of the user;
determining modifications of the virtual 3D representation of the product based on the monitored user interactions;
presenting, in the AR scene, a modified 3D representation of the product;
converting the modified 3D representation of the product to a second 2D image for replacing the first 2D image based on obtaining an image of the modified 3D representation of the product as output by a virtual camera associated with the AR scene; and
causing the first graphical user interface to be updated in real-time responsive to the monitored user interactions based on displaying the second 2D image in place of the first 2D image on the first graphical user interface in AR.