US 12,086,872 B2
System and method for populating a virtual shopping cart based on video of a customer's shopping session at a physical store
Matthew Raymond Magee, Waco, TX (US); Shahmeer Ali Mirza, Celina, TX (US); Joshua E. Berry, Waco, TX (US); Trong Nghia Nguyen, Dallas, TX (US); Ravi Kumar Kurva, Irving, TX (US); Sarath Vakacharla, Irving, TX (US); Ranganathan Mohan, Frisco, TX (US); Maninder Singh Suri, Irving, TX (US); and Jonathan Christopher Hodge, Frisco, TX (US)
Assigned to 7-ELEVEN, INC., Irving, TX (US)
Filed by 7-ELEVEN, INC., Irving, TX (US)
Filed on Feb. 22, 2022, as Appl. No. 17/652,069.
Application 17/652,069 is a continuation of application No. 17/021,011, filed on Sep. 15, 2020, granted, now 11,341,569.
Application 17/021,011 is a continuation of application No. 16/663,589, filed on Oct. 25, 2019, granted, now 10,861,085, issued on Dec. 8, 2020.
Prior Publication US 2022/0180424 A1, Jun. 9, 2022
Int. Cl. G06F 3/048 (2013.01); G06Q 30/0601 (2023.01); G09G 5/14 (2006.01); G06F 3/0486 (2013.01); G06Q 30/06 (2023.01); H04N 7/18 (2006.01)
CPC G06Q 30/0643 (2013.01) [G09G 5/14 (2013.01); G06F 3/0486 (2013.01); G09G 2354/00 (2013.01); H04N 7/181 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a hardware processor configured to:
display a first virtual rack configured to emulate a first physical rack;
display a video that depicts an event comprising a person interacting with the first physical rack during a shopping session;
display a virtual shopping cart;
receive information associated with the event, the information identifying a first virtual item corresponding to a first physical item, wherein the video depicts that the person selected the first physical item while interacting with the first physical rack, wherein receiving the information associated with the event comprises:
detecting that a slider on a slider bar associated with the video has reached a marker on the slider bar; and,
in association with the event, determining a position of the marker based at least in part upon sensor data received from a camera directed to the first physical rack, wherein the marker comprises at least one of a first identification number indicating the first physical rack or a second identification number indicating the first virtual rack;
in response to receiving the information associated with the event, store the first virtual item in the virtual shopping cart; and
in response to determining that the shopping session has ended, compare the virtual shopping cart to an algorithmic shopping cart comprising items determined by an algorithm to have been selected during the shopping session, the algorithmic shopping cart determined based on a set of inputs received from sensors located within a physical store, wherein:
the virtual shopping cart is determined independently from the algorithmic shopping cart; and
the algorithmic shopping cart is generated based at least in part upon input from a weight sensor.