Object detection based on wrist-area region-of-interest
Sumedh Vilas Datar, Grapevine, TX (US); Sailesh Bharathwaaj Krishnamurthy, Irving, TX (US); and Shahmeer Ali Mirza, Celina, TX (US)
Assigned to 7-ELEVEN, INC., Irving, TX (US)
Filed by 7-Eleven, Inc., Irving, TX (US)
Filed on Jun. 15, 2022, as Appl. No. 17/840,704.
Application 17/840,704 is a continuation of application No. 17/104,364, filed on Nov. 25, 2020, granted, now 11,403,852.
Application 17/104,364 is a continuation in part of application No. 16/663,710, filed on Oct. 25, 2019, granted, now 11,188,763, issued on Nov. 30, 2021.
Application 16/663,710 is a continuation in part of application No. 16/663,766, filed on Oct. 25, 2019, granted, now 11,132,550, issued on Sep. 28, 2021.
Application 16/663,766 is a continuation in part of application No. 16/663,451, filed on Oct. 25, 2019, granted, now 10,943,287, issued on Mar. 9, 2021.
Application 16/663,451 is a continuation in part of application No. 16/663,794, filed on Oct. 25, 2019, granted, now 11,367,124.
Application 16/663,794 is a continuation in part of application No. 16/663,822, filed on Oct. 25, 2019, granted, now 11,113,837, issued on Sep. 7, 2021.
Application 16/663,822 is a continuation in part of application No. 16/941,415, filed on Jul. 28, 2020, granted, now 11,430,222.
Application 16/941,415 is a continuation of application No. 16/794,057, filed on Feb. 18, 2020, granted, now 10,769,451, issued on Sep. 8, 2020.
Application 16/794,057 is a continuation of application No. 16/663,472, filed on Oct. 25, 2019, granted, now 10,614,318, issued on Apr. 7, 2020.
Application 17/104,364 is a continuation in part of application No. 16/663,856, filed on Oct. 25, 2019, granted, now 10,956,777, issued on Mar. 23, 2021.
Application 16/663,856 is a continuation in part of application No. 16/664,160, filed on Oct. 25, 2019, granted, now 11,568,554.
Application 16/664,160 is a continuation in part of application No. 17/071,262, filed on Oct. 15, 2020.
Application 17/071,262 is a continuation of application No. 16/857,990, filed on Apr. 24, 2020, granted, now 10,853,663, issued on Dec. 1, 2020.
Application 16/857,990 is a continuation of application No. 16/793,998, filed on Feb. 18, 2020, granted, now 10,685,237, issued on Jun. 16, 2020.
Application 16/793,998 is a continuation of application No. 16/663,500, filed on Oct. 25, 2019, granted, now 10,621,444, issued on Apr. 14, 2020.
Application 17/104,364 is a continuation in part of application No. 16/857,990, filed on Apr. 24, 2020, granted, now 10,853,663, issued on Dec. 1, 2020.
Application 16/857,990 is a continuation of application No. 16/793,998, filed on Feb. 18, 2020, granted, now 10,685,237, issued on Jun. 16, 2020.
Application 16/793,998 is a continuation of application No. 16/663,500, filed on Oct. 25, 2019, granted, now 10,621,444, issued on Apr. 14, 2020.
Application 17/104,364 is a continuation in part of application No. 16/664,219, filed on Oct. 25, 2019, granted, now 11,107,226, issued on Aug. 31, 2021.
Application 16/664,219 is a continuation in part of application No. 16/664,269, filed on Oct. 25, 2019, granted, now 11,004,219, issued on May 11, 2021.
Application 16/664,269 is a continuation of application No. 16/664,332, filed on Oct. 25, 2019, granted, now 11,176,686, issued on Nov. 16, 2021.
Application 16/664,332 is a continuation in part of application No. 16/664,363, filed on Oct. 25, 2019, granted, now 11,080,529, issued on Aug. 3, 2021.
Application 16/664,363 is a continuation in part of application No. 16/664,391, filed on Oct. 25, 2019, granted, now 11,062,147, issued on Jul. 13, 2021.
Application 16/664,391 is a continuation in part of application No. 16/664,426, filed on Oct. 25, 2019, granted, now 11,308,630, issued on Apr. 19, 2022.
Application 16/664,426 is a continuation in part of application No. 16/884,434, filed on May 27, 2020, granted, now 11,205,277, issued on Dec. 21, 2021.
Application 16/884,434 is a continuation of application No. 16/663,533, filed on Oct. 25, 2019, granted, now 10,789,720, issued on Sep. 29, 2020.
Application 17/104,364 is a continuation of application No. 16/663,901, filed on Oct. 25, 2019, granted, now 11,430,046.
Application 16/663,901 is a continuation in part of application No. 16/663,948, filed on Oct. 25, 2019, granted, now 11,257,225, issued on Feb. 22, 2022.
Prior Publication US 2022/0327836 A1, Oct. 13, 2022
an image sensor positioned such that a field-of-view of the image sensor encompasses at least a portion of a rack comprising shelves configured to store items, wherein the image sensor is configured to generate images of the items stored on the shelves of the rack; and
a tracking subsystem coupled to the image sensor, the tracking subsystem comprising at least one processor configured to:
over a period of time, track a pixel position of the wrist of a person interacting with the items stored on the shelves of the rack;
determine, based on the pixel positions tracked over the period of time, a maximum depth into the rack to which the person reached over the period of time;
determine candidate items based on the maximum depth into the rack to which the person reached over the period of time, wherein the candidate items include a first item associated with the determined maximum depth into the rack to which the person reached over the period of time and one or more items at adjacent positions in the rack to the first item;
for each candidate item, determine, based on a comparison of a predefined position associated with the candidate items to the maximum depth into the rack to which the person reached over the period of time, a probability value that the candidate item was interacted with by the person;
if a highest probability value determined for the candidate items is greater than a threshold value, determine that reliability criteria are satisfied and identify the first item based at least in part on the determined probability values;
if the highest probability value determined for the candidate items is less than the threshold value, determine that the reliability criteria are not satisfied and identify the first item using an object detection algorithm; and
