US 11,875,823 B2
Hypermedia enabled procedures for industrial workflows on a voice driven platform
Ashwath Kakde, Bangalore (IN); Unnikrishnan Poduval, Bangalore (IN); Venkata Srinivasulu Reddy Talamanchi, Bangalore (IN); Ramesh Gadamsetty Venkata Naga, Bangalore (IN); and Prasad Panambur Kamath, Bengaluru (IN)
Assigned to Honeywell International Inc., Morris Plains, NJ (US)
Filed by Honeywell International Inc., Morris Plains, NJ (US)
Filed on Apr. 6, 2020, as Appl. No. 16/841,454.
Prior Publication US 2021/0312950 A1, Oct. 7, 2021
Int. Cl. G11B 27/34 (2006.01); G06F 16/738 (2019.01); G06V 20/40 (2022.01); G06F 16/74 (2019.01)
CPC G11B 27/34 (2013.01) [G06F 16/738 (2019.01); G06V 20/49 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, cause the processor to:
identify a video procedure comprising at least a main video procedure, the video procedure corresponding to an industrial task comprising a plurality of sub-steps, the plurality of sub-steps comprising at least a first branch of sub-steps from a main set of steps and a second branch of sub-steps from the main set of steps, wherein the first branch of sub-steps includes at least one step that differs from the second branch of sub-steps;
compare media data related to a first sub-step of the plurality of sub-steps with a category dictionary to determine a category for the first sub-step of the video procedure, wherein the category dictionary comprises a mapping of keywords to a plurality of categories;
link, based on the category of the first sub-step of the video procedure, the first sub-step of the video procedure with at least a portion of a second video procedure to generate a hypervideo for the industrial task, wherein the hypervideo is a video stream that comprises one or more interactive hypermedia elements associated with the industrial task, wherein the hypervideo corresponds to a first branch from the main video procedure, wherein the first branch from the main video corresponds to the first branch of sub-steps, and wherein the video procedure comprises at least a second sub-step of the video procedure that represents a second branch from the main video procedure, wherein the second branch from the main video corresponds to the second branch of sub-steps;
display the hypervideo via a head-mounted visual display of a wearable device; and
display, via the head-mounted visual display of the wearable device, a second hypervideo simultaneously with the first hypervideo,
wherein interaction with the second hypervideo switches to the second branch from the main video procedure.