Event trigger based on region-of-interest near hand-shelf interaction
Sumedh Vilas Datar, Grapevine, TX (US); Sailesh Bharathwaaj Krishnamurthy, Irving, TX (US); and Shahmeer Ali Mirza, Celina, TX (US)
Assigned to 7-ELEVEN, INC., Irving, TX (US)
Filed by 7-Eleven, Inc., Irving, TX (US)
Filed on Jun. 23, 2022, as Appl. No. 17/847,880.
Application 17/847,880 is a continuation of application No. 17/161,530, filed on Jan. 28, 2021, granted, now 11,423,657.
Application 17/161,530 is a continuation of application No. 17/104,521, filed on Nov. 25, 2020, granted, now 11,003,918, issued on May 11, 2021.
Application 17/104,521 is a continuation in part of application No. 17/071,262, filed on Oct. 15, 2020.
Application 17/071,262 is a continuation in part of application No. 16/941,415, filed on Jul. 28, 2020, granted, now 11,430,222.
Application 16/941,415 is a continuation in part of application No. 16/884,434, filed on May 27, 2020, granted, now 11,205,277, issued on Dec. 21, 2021.
Application 17/071,262 is a continuation of application No. 16/857,990, filed on Apr. 24, 2020, granted, now 10,853,663, issued on Dec. 1, 2020.
Application 17/161,530 is a continuation in part of application No. 16/857,990, filed on Apr. 24, 2020, granted, now 10,853,663, issued on Dec. 1, 2020.
Application 16/857,990 is a continuation of application No. 16/793,998, filed on Feb. 18, 2020, granted, now 10,685,237, issued on Jun. 16, 2020.
Application 16/941,415 is a continuation of application No. 16/794,057, filed on Feb. 18, 2020, granted, now 10,769,451, issued on Sep. 8, 2020.
Application 17/161,530 is a continuation in part of application No. 16/664,219, filed on Oct. 25, 2019, granted, now 11,107,226, issued on Aug. 31, 2021.
Application 16/793,998 is a continuation of application No. 16/663,500, filed on Oct. 25, 2019, granted, now 10,621,444, issued on Apr. 14, 2020.
Application 17/161,530 is a continuation in part of application No. 16/664,426, filed on Oct. 25, 2019, granted, now 11,308,630, issued on Apr. 19, 2022.
Application 16/884,434 is a continuation of application No. 16/663,533, filed on Oct. 25, 2019, granted, now 10,789,720, issued on Sep. 29, 2020.
Application 17/161,530 is a continuation in part of application No. 16/663,856, filed on Oct. 25, 2019, granted, now 10,956,777, issued on Mar. 23, 2021.
Application 16/663,856 is a continuation in part of application No. 16/664,269, filed on Oct. 25, 2019, granted, now 11,004,219.
Application 16/664,269 is a continuation in part of application No. 16/663,822, filed on Oct. 25, 2019, granted, now 11,113,837, issued on Sep. 7, 2021.
Application 16/663,822 is a continuation in part of application No. 16/664,363, filed on Oct. 25, 2019, granted, now 11,080,529, issued on Aug. 3, 2021.
Application 16/664,363 is a continuation in part of application No. 16/663,766, filed on Oct. 25, 2019, granted, now 11,132,550, issued on Sep. 28, 2021.
Application 16/663,766 is a continuation in part of application No. 16/664,391, filed on Oct. 25, 2019, granted, now 11,062,147, issued on Jul. 13, 2021.
Application 16/664,391 is a continuation in part of application No. 16/663,901, filed on Oct. 25, 2019, granted, now 11,430,046.
Application 16/663,901 is a continuation in part of application No. 16/663,451, filed on Oct. 25, 2019, granted, now 10,943,287, issued on Mar. 9, 2021.
Application 16/663,451 is a continuation in part of application No. 16/664,332, filed on Oct. 25, 2019, granted, now 11,176,686, issued on Nov. 16, 2021.
Application 16/664,332 is a continuation in part of application No. 16/664,160, filed on Oct. 25, 2019.
Application 16/794,057 is a continuation of application No. 16/663,472, filed on Oct. 25, 2019, granted, now 10,614,318, issued on Apr. 7, 2020.
Application 17/161,530 is a continuation in part of application No. 16/663,948, filed on Oct. 25, 2019, granted, now 11,257,225, issued on Feb. 22, 2022.
Application 16/663,948 is a continuation in part of application No. 16/663,794, filed on Oct. 25, 2019, granted, now 11,367,124, issued on Jun. 21, 2022.
Application 17/104,521 is a continuation in part of application No. 16/663,710, filed on Oct. 25, 2019, granted, now 11,188,763, issued on Nov. 30, 2021.
Prior Publication US 2022/0327837 A1, Oct. 13, 2022
an image sensor positioned such that a field-of-view of the image sensor encompasses at least a portion of the object, wherein the image sensor is configured to generate images of the stored items; and
a tracking subsystem coupled to the image sensor, the tracking subsystem comprising at least one processor configured to:
determine, using a set of images generated by the image sensor, a pixel position of a body part of a person in each image of the set of images;
determine a set of pixel positions of the body part during a timeframe associated with the set of images;
determine an aggregated body part position based on the set of pixel positions determined for the timeframe;
determine that the aggregated body part position corresponds to a position associated with the object;
in response to determining that the aggregated body part position corresponds to a position associated with the object, provide a trigger signal indicating an interaction event has occurred;
determine at least one item-selection image associated with a person removing a first item from the object;
determine, in the at least one item-selection image, a region-of-interest based on the aggregated body part position, wherein the region-of-interest includes a subset of the pixels of the item-selection image;
identify, using an object detection algorithm, the first item in the selected region-of-interest; and
