US 12,488,384 B2
Build and update a virtual store based on a physical store
Juho Mikko Haapoja, Toronto (CA); Byron Leonel Delgado, Ottawa (CA); and Stephan Leroux, East Gwillimbury (CA)
Assigned to SHOPIFY INC., Ottowa (CA)
Filed by SHOPIFY INC., Ottawa (CA)
Filed on May 27, 2021, as Appl. No. 17/332,775.
Prior Publication US 2022/0383396 A1, Dec. 1, 2022
Int. Cl. G06Q 30/00 (2023.01); G06Q 30/0601 (2023.01); G06T 7/70 (2017.01)
CPC G06Q 30/0643 (2013.01) [G06Q 30/0639 (2013.01); G06T 7/70 (2017.01); G06T 2200/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a computer, captured images of a physical space having a set of objects wherein the physical space is simulated by a three-dimensional (3D) model of the physical space and a corresponding representation of the set of objects positioned relative to the 3D model;
determining, by the computer based on the captured images, information for objects in the physical space, the determining including:
segmenting, based on at least one visual attribute, the captured images into a plurality of portions,
extracting at least a portion of the captured images, and
identifying the objects based on the extracted at least the portion of the captured images,
wherein when an identity of a first object is not determined using a first captured image, the computer identifies the first object using a second captured image that depicts the first object; and
generating, by the computer based on the object information, an updated representation of the set of objects in the 3D model based on the object information, wherein the updated representation of the set of objects corresponds to the objects in the physical space as shown in the captured images.