US 12,229,716 B1
Event determination and presentation
Jason Michael Famularo, Seattle, WA (US); Amber Autrey Taylor, Seattle, WA (US); Dilip Kumar, Seattle, WA (US); Gianna Lise Puerini, Seattle, WA (US); and Thomas Meilandt Mathiesen, Seattle, WA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Apr. 25, 2022, as Appl. No. 17/728,521.
Application 17/728,521 is a continuation of application No. 16/459,168, filed on Jul. 1, 2019, granted, now 11,315,073.
Application 16/459,168 is a continuation of application No. 14/313,900, filed on Jun. 24, 2014, granted, now 10,339,493, issued on Jul. 2, 2019.
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 10/00 (2023.01); G06Q 10/087 (2023.01); G06V 40/12 (2022.01); G06V 40/18 (2022.01)
CPC G06Q 10/087 (2013.01) [G06V 40/1365 (2022.01); G06V 40/197 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
detecting, based at least in part on image data received from an overhead camera positioned with a materials handling facility, an occurrence of an event within the materials handling facility, wherein the event includes an action, an item, and a user;
in response to detecting the occurrence of the event:
receiving, at a computing system, data generated by one or more of a plurality of devices positioned within the materials handling facility;
processing, with the computing system, at least a first portion of the data to determine the action involved in the event and an action confidence score that the action has been accurately determined;
processing, with the computing system, at least a second portion of the data to determine the item involved in the event and an item confidence score that the item has been properly determined; and
processing, with the computing system, at least a third portion of the data to determine the user involved in the event and a user confidence score that the user has been properly determined;
determining that:
the action confidence score exceeds a first threshold;
the item confidence score exceeds a second threshold; and
the user confidence score exceeds a third threshold; and
in response to determining that the action confidence score exceeds the first threshold, the item confidence score exceeds the second threshold, and the user confidence score exceeds the third threshold, sending, for presentation, event information indicating at least the action and the item.