US 11,704,362 B2
Assigning case identifiers to video streams
Manish Garg, Fremont, CA (US); Mubarak Abdulla, Kerala (IN); Sanjyot Gindi, Pune (IN); Aanjan Hari, Karnataka (IN); Evgueni Hadjev, Los Altos, CA (US); Ajay Gabale, Pin (IN); Avinash Misra, Plano, TX (US); and Anoop Mishra, Sunnyvale, CA (US)
Assigned to SKAN INC., San Jose, CA (US)
Filed by Skan Inc., San Jose, CA (US)
Filed on Aug. 12, 2020, as Appl. No. 16/991,388.
Claims priority of application No. 202041019067 (IN), filed on May 5, 2020.
Prior Publication US 2021/0349941 A1, Nov. 11, 2021
Int. Cl. G06F 16/75 (2019.01); G06F 16/783 (2019.01); G06V 20/40 (2022.01)
CPC G06F 16/75 (2019.01) [G06F 16/7844 (2019.01); G06V 20/41 (2022.01); G06V 20/44 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of assigning case identifiers to video streams of one or more worker devices, the method comprising:
obtaining, for each worker device, a series of images capturing a screen of the worker device while the worker device processes a case of an operation process;
grouping images of the series of images into one or more groups of images;
for an image in a group of images obtained from a worker device:
extracting text data included in the image, the text data of the image including one or more data values,
determining labels for the one or more data values in the text data,
determining a case identifier specific to a case being processed in the image, the case identifier determined by identifying a label for the case identifier and determining a data value associated with the label as the case identifier for the image, and
assigning the case identifier to the group of images;
determining an activity label for the group of images obtained from the worker device, the activity label indicating an activity performed on the worker device when the group of images were captured, and wherein the activity label is determined by extracting information from pixels of the group of images and inferring the activity of the worker device from the extracted information; and
generating an event log associating the assigned case identifier to the activity label for the group of images.