US 12,223,710 B2
Image cropping using depth information
Sailesh Bharathwaaj Krishnamurthy, Irving, TX (US); Sumedh Vilas Datar, Grapevine, TX (US); Crystal Maung, Dallas, TX (US); and Shantanu Yadunath Thakurdesai, Denton, TX (US)
Assigned to 7-ELEVEN, INC., Irving, TX (US)
Filed by 7-Eleven, Inc., Irving, TX (US)
Filed on Nov. 19, 2021, as Appl. No. 17/455,907.
Application 17/455,907 is a continuation in part of application No. 17/362,261, filed on Jun. 29, 2021, granted, now 11,887,332.
Prior Publication US 2022/0414375 A1, Dec. 29, 2022
Int. Cl. G06V 20/00 (2022.01); G01G 21/22 (2006.01); G01S 17/894 (2020.01); G06F 18/22 (2023.01); G06F 18/24 (2023.01); G06N 3/08 (2023.01); G06T 7/136 (2017.01); G06T 7/50 (2017.01); G06V 10/75 (2022.01); H04N 13/204 (2018.01); H04N 13/271 (2018.01); H04N 23/80 (2023.01); H04N 23/90 (2023.01)
CPC G06V 20/00 (2022.01) [G06F 18/22 (2023.01); G06F 18/24 (2023.01); G06N 3/08 (2013.01); G06T 7/136 (2017.01); G06T 7/50 (2017.01); G06V 10/751 (2022.01); H04N 13/204 (2018.05); H04N 13/271 (2018.05); H04N 23/80 (2023.01); H04N 23/90 (2023.01); G01G 21/22 (2013.01); G01S 17/894 (2020.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20132 (2013.01); G06T 2207/20221 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An item tracking system, comprising:
a camera configured to capture images of at least a portion of a platform; and
a three-dimensional (3D) sensor configured to capture depth images of at least a portion of the platform, wherein each pixel in the depth images comprises depth information identifying a distance between the 3D sensor and a surface in the depth image; and
a processor operably coupled to the camera and the 3D sensor, and configured to:
capture a first image of the item on the platform using the camera;
identify a plurality of pixels corresponding with the item in the first image;
determine a first number of pixels in the plurality of pixels corresponding with the item;
capture a first depth image of an item on the platform using the 3D sensor;
determine a second number of pixels within the first depth image corresponding with the item;
determine a difference between the first number of pixels in the plurality of pixels corresponding with the item in the first image and the second number of pixels in the first depth image;
compare the difference between the first number of pixels in the plurality of pixels corresponding with the item in the first image and the second number of pixels in the first depth image to a difference threshold value, wherein the difference threshold value identifies a maximum pixel difference;
determine that the difference between the first number of pixels in the plurality of pixels corresponding with the item in the first image and the second number of pixels in the first depth image is less than the difference threshold value;
extract the plurality of pixels corresponding with the item in the first image from the first image to generate a second image in response to the determination that the difference between the first number of pixels in the plurality of pixels corresponding with the item in the first image and the second number of pixels in the first depth image is less than the difference threshold value; and
output the second image.