US 11,842,385 B2
Methods, systems, and manufacture for an e-commerce platform with augmented reality application for display of virtual objects
Daniel Beauchamp, Toronto (CA)
Assigned to SHOPIFY INC., Ottawa (CA)
Filed by Shopify Inc., Ottawa (CA)
Filed on Apr. 1, 2022, as Appl. No. 17/711,536.
Application 17/711,536 is a continuation of application No. 16/229,369, filed on Dec. 21, 2018, granted, now 11,321,768.
Prior Publication US 2022/0222741 A1, Jul. 14, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 30/00 (2023.01); G06Q 30/0601 (2023.01); G06F 3/04815 (2022.01); G06Q 30/06 (2023.01); G06V 20/64 (2022.01)
CPC G06Q 30/0643 (2013.01) [G06F 3/04815 (2013.01); G06Q 30/06 (2013.01); G06Q 30/0601 (2013.01); G06Q 30/0641 (2013.01); G06V 20/64 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for augmenting a customer image with at least one virtual object, the method comprising:
receiving a plurality of customer images from a first computing device, wherein each of the plurality of customer images depicts a respective different 2D view of a customer environment;
determining 3D feature data corresponding to each of the plurality of customer images;
receiving a selection of a merchant item for display;
determining a virtual object corresponding to the selection of a merchant item;
receiving from the first computing device a positioning signal corresponding to a desired location of the virtual object in a particular 2D view of the customer environment;
determining a corresponding first location in each of the plurality of customer images at which to overlay the virtual object based on the positioning signal, the corresponding first location corresponding to the desired location in each respective different 2D view of the customer environment;
determining a size and orientation of the virtual object in each of the plurality of customer images based on corresponding 3D feature data;
causing an overlay of the virtual object, having the determined size and orientation, at the corresponding first location in each of the plurality of customer images to create a respective plurality of augmented images for display on a second computing device, wherein the second computing device is a separate device from the first computing device;
receiving a re-positioning signal indicative of a desired re-positioned location of the virtual object in the particular 2D view or a different 2D view of the customer environment;
determining a corresponding second location in each of the plurality of customer images at which to overlay the virtual object based on the re-positioning signal, the corresponding second location corresponding to the desired re-positioned location in each respective different 2D view of the customer environment; and
updating the overlay of the virtual object to be positioned at the corresponding second location in each of the plurality of customer images.