US 12,243,333 B2
Method for determining one or more storage boxes for storing objects
Camila Dorin, Lund (SE)
Assigned to Inter IKEA Systems B.V., LN Delft (NL)
Filed by Inter IKEA Systems B.V., Delft (NL)
Filed on Apr. 6, 2022, as Appl. No. 17/714,750.
Claims priority of application No. 21167446 (EP), filed on Apr. 8, 2021.
Prior Publication US 2022/0327846 A1, Oct. 13, 2022
Int. Cl. G06V 20/64 (2022.01); G06Q 30/0601 (2023.01); G06T 7/11 (2017.01); G06T 7/62 (2017.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/70 (2022.01); G06Q 10/087 (2023.01)
CPC G06V 20/64 (2022.01) [G06Q 30/0631 (2013.01); G06T 7/11 (2017.01); G06T 7/62 (2017.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/70 (2022.01); G06Q 10/087 (2013.01); G06T 2207/10028 (2013.01); G06V 2201/10 (2022.01); G06V 2201/12 (2022.01)] 49 Claims
OG exemplary drawing
 
1. A computer implemented method for determining one or more storage boxes for storing objects, the method comprising:
scanning, by an imaging sensor, a plurality of objects, to acquire a scan of the plurality of objects;
segmenting the scan of the plurality of objects into segmented objects;
assigning metadata to a segmented object, wherein to assign the metadata to the segmented object includes to:
compare characteristics of the segmented object with characteristics of objects stored in a database, and
upon a positive match, assign the metadata to the segmented object and storing the metadata as assigned to the segmented object in the database, wherein the metadata comprises information on a 3D measure of an object;
determining a three-dimensional (3D) measure of each of the segmented objects, wherein the 3D measure of the segmented object is determined from the metadata;
grouping the segmented objects into one or more groups of objects; and
determining, for a group of objects of the one or more groups of objects, one or more candidate storage boxes for storing the group of objects by:
calculating a total 3D measure for the group of objects by combining the 3D measure of each object of the group of objects; and
comparing the total 3D measure for the group of objects with inner dimensions of a set of potential storage boxes.
 
17. A computer implemented method for determining one or more storage boxes for storing objects, the method comprising:
scanning, by an imaging sensor, a plurality of objects, to acquire a scan of the plurality of objects;
segmenting the scan of the plurality of objects into segmented objects;
determining a three-dimensional (3D) measure of each of the segmented objects;
grouping the segmented objects into one or more groups of objects, wherein grouping the objects into the one or more groups of objects comprises:
categorizing the segmented objects; and
grouping the segmented objects belonging to a same object category into one of the one or more groups of objects; and
determining, for a group of objects of the one or more groups of objects, one or more candidate storage boxes for storing the group of objects by:
calculating a total 3D measure for the group of objects by combining the 3D measure of each object of the group of objects;
comparing the total 3D measure for the group of objects with inner dimensions of a set of potential storage boxes; and
selecting the set of potential storage boxes from a group of storage boxes based on the object category of the objects in the group of objects and/or an appearance of boxes of the group of storage boxes.
 
33. A computer implemented method for determining one or more storage boxes for storing objects, the method comprising:
scanning, by an imaging sensor, a plurality of objects, to acquire a scan of the plurality of objects;
segmenting the scan of the plurality of objects into segmented objects;
determining a three-dimensional (3D) measure of each of the segmented objects;
grouping the segmented objects into one or more groups of objects; and
determining, for a group of objects of the one or more groups of objects, one or more candidate storage boxes for storing the group of objects by:
calculating a total 3D measure for the group of objects by combining the 3D measure of each object of the group of objects;
identifying storage boxes comprising objects corresponding to the group of objects from a plurality of images of home environments;
selecting a set of potential storage boxes from a group of storage boxes based on the identified storage boxes; and
comparing the total 3D measure for the group of objects with inner dimensions of the set of potential storage boxes.
 
49. A non-transitory computer-readable storage medium having stored thereon instructions which, when executed on a device having processing capabilities, cause the device to:
scan, by the imaging sensor, a plurality of objects to be stored to acquire a scan of the plurality of objects;
segment the scan of the plurality of objects into segmented objects;
determine a three-dimensional (3D) measure of each of the plurality of objects;
calculate a total 3D measure for the plurality of objects;
compare the total 3D measure for the plurality of objects with inner dimensions of a set of potential storage boxes to determine one or more candidate storage boxes for storing the plurality of objects, wherein the one or more candidate storage boxes comprises a set of different storage boxes, each box in the set of different boxes having a different appearance;
display a representation of each of the one or more candidate storage boxes on a display; and
receive user input selecting at least one storage box among the one or more candidate storage boxes.