US 12,190,584 B2
Operation management system utilizing a wearable device
Matthew Louis Kowalski, Merrick, NY (US); Andrew Ehlers, Elmhurst, IL (US); Nathan J. Clevenger, Burnsville, MN (US); Scott R. Olson, St. Paul, MN (US); Seth David Silk, Barrington, IL (US); and Nicole Daphne Tricoukes, Seaford, NY (US)
Assigned to Zebra Technologies Corporation, Lincolnshire, IL (US)
Appl. No. 18/274,269
Filed by Zebra Technologies Corporation, Lincolnshire, IL (US)
PCT Filed Dec. 21, 2021, PCT No. PCT/US2021/064515
§ 371(c)(1), (2) Date Jul. 26, 2023,
PCT Pub. No. WO2022/164550, PCT Pub. Date Aug. 4, 2022.
Application 18/274,269 is a continuation of application No. 17/161,011, filed on Jan. 28, 2021, granted, now 11,651,590, issued on May 16, 2023.
Prior Publication US 2024/0119732 A1, Apr. 11, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/00 (2022.01); G06F 1/16 (2006.01); G06F 18/214 (2023.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01)
CPC G06V 20/41 (2022.01) [G06F 1/163 (2013.01); G06F 18/214 (2023.01); G06V 20/20 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, by a device, a video stream from a wearable device;
determining, by the device, that the video stream is associated with a user of the wearable device, the user performing an operation in a physical environment;
processing, by the device and using an operation performance model, a set of frames of the video stream indicative of a state of a performance of the operation by the user,
determining, by the device and based on the state of the performance by the user, a next task of the operation;
identifying, by the device and using the operation performance model, a physical object within the physical environment depicted in the set of frames;
determining, based on reference image data associated with the operation, that the physical object is associated with the next task;
configuring, by the device, display data associated with the physical object and associated with the next task; and
providing, by the device, the display data to the wearable device, wherein
the operation performance model is trained based on a plurality of historical videos indicative of historical performances of the operation by other users of other wearable devices,
the plurality of historical videos being captured by the other wearable devices, and
the display data is associated with an indicator that identifies the physical object and task information associated with performing the next task.