US 12,277,656 B2
AR-based visualization of activity with collaboration amelioration
Fang Lu, Billerica, MA (US); Jeremy R. Fox, Georgetown, TX (US); Tushar Agrawal, West Fargo, ND (US); and Sarbajit K. Rakshit, Kolkata (IN)
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed by INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US)
Filed on Feb. 9, 2023, as Appl. No. 18/166,660.
Prior Publication US 2024/0273827 A1, Aug. 15, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/04847 (2022.01); G06Q 10/0633 (2023.01); G06Q 10/067 (2023.01); G06T 13/40 (2011.01)
CPC G06T 19/006 (2013.01) [G06F 3/04847 (2013.01); G06Q 10/0633 (2013.01); G06Q 10/067 (2013.01); G06T 13/40 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-based method of augmented reality (AR)-based visualization of an activity with collaboration amelioration, the method comprising:
receiving real-time and historical data relating to an activity in an industrial environment;
identifying each step of the activity and a time to complete each step of the activity based on the historical data;
executing a plurality of digital twin simulations of different combinations of avatars of different types of workers performing each step of the activity based on the historical data;
determining whether a current distribution of human and robotic workers in the industrial environment is optimized based on a comparative evaluation of the plurality of digital twin simulations, wherein the current distribution of the human and the robotic workers is defined by a number and types of workers assigned to perform each step of the activity, and wherein the current distribution of the human and the robotic workers is optimized when no alternative distribution of the human and the robotic workers results in higher production quantity output;
in response to determining the current distribution is not optimized, prompting a manager with an AR overlaid slider bar regarding an objective of the manager;
generating a knowledge corpus including an optimized distribution of the human and the robotic workers based on the objective of the manager and the comparative evaluation;
creating a visual animation of the optimized distribution of the human and the robotic workers in the industrial environment based on the knowledge corpus, wherein the optimized distribution differs from the current distribution; and
displaying the visual animation to at least one human worker via an AR device as a digital image overlay.