US 11,887,332 B2
Item identification using digital image processing
Sailesh Bharathwaaj Krishnamurthy, Irving, TX (US); Sumedh Vilas Datar, Grapevine, TX (US); Shantanu Yadunath Thakurdesai, Denton, TX (US); and Crystal Maung, Dallas, TX (US)
Assigned to 7-ELEVEN, INC., Irving, TX (US)
Filed by 7-Eleven, Inc., Irving, TX (US)
Filed on Jun. 29, 2021, as Appl. No. 17/362,261.
Prior Publication US 2022/0414924 A1, Dec. 29, 2022
Int. Cl. G06T 7/73 (2017.01); G06T 7/55 (2017.01); G06N 20/00 (2019.01); H04N 23/90 (2023.01)
CPC G06T 7/74 (2017.01) [G06N 20/00 (2019.01); G06T 7/55 (2017.01); H04N 23/90 (2023.01)] 42 Claims
OG exemplary drawing
 
1. An item tracking system, comprising:
a plurality of cameras, wherein each camera is configured to capture images of at least a portion of a platform; and
a three-dimensional (3D) sensor positioned above the platform, wherein the 3D sensor is configured to capture overhead depth images of items placed on the platform, wherein each overhead depth image is configured to capture upward-facing surfaces of items placed on the platform;
a memory operable to store user account information for a plurality of users; and
a processor operably coupled to the memory, and configured to:
detect a triggering event at the platform, wherein the triggering event corresponds with a user placing items on the platform;
capture an overhead depth image of a first item and a second item on the platform using the 3D sensor;
determine a first object pose for the first item based at least in part upon the overhead depth image, wherein determining the first object pose comprises determining a first orientation for the first item with respect to the platform;
determine a second object pose for the second item based at least in part upon the overhead depth image, wherein determining the second object pose comprises determining a second orientation for the second item with respect to the platform;
identify a first camera from among the plurality of cameras based at least in part upon the first object pose for the first item;
identify a second camera from among the plurality of cameras based at least in part upon the second object pose for the second item, wherein the second camera is different from the first camera;
capture a first image of the first item using the first camera, wherein:
the first image comprises one or more features of the first item; and
each feature corresponds with a physical attribute of the first item;
capture a second image of the second item using the second camera, wherein:
the second image comprises one or more features of the second item; and
each feature corresponds with a physical attribute of the second item;
identify the first item within the first image based at least in part upon features of the first item;
identify the second item within the second image based at least in part upon features of the second item;
identify the user associated with the first item and the second item;
identify an account within the user account information that is associated with the user; and
associate the first item and the second item with the account of the user.