US 12,436,995 B1
Interactive user assistance system with rich multimodal content experience
Min Gong, Shanghai (CN); Zijia Wang, London (GB); and Deepaganesh Paulraj, Bangalore (IN)
Assigned to Dell Products L.P., Round Rock, TX (US)
Filed by Dell Products L.P., Round Rock, TX (US)
Filed on Jun. 28, 2024, as Appl. No. 18/758,095.
Int. Cl. G06F 16/70 (2019.01); G06F 16/73 (2019.01); G06F 16/90 (2019.01); G06F 16/955 (2019.01)
CPC G06F 16/73 (2019.01) [G06F 16/9558 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method for managing an interactive user assistance system that provides a rich multimodal content experience for a user, the method comprising:
obtaining an input from the user;
generating a response to the input using one or more machine learning models;
identifying one or more referenceable terms within the response using the response and a video hierarchy and semantic representation database, the video hierarchy and semantic representation database that comprises a semantic vector space in which a plurality of semantic representations of video clips of videos are stored and a hierarchically managed video clip pool, the hierarchically managed video clip pool comprises, for a first video among the videos:
first video clips clipped from the first video;
a first video hierarchy, of one or more video hierarchies that indicate a hierarchical association between each of the videos and video clips of the videos, created for the first video and the first video clips;
a semantic representation, of the plurality of semantic representations, generated for each of the first video and the first video clips,
wherein the semantic representation of each of the first video and the first video clips are stored into the semantic vector space, the semantic vector space and information associated with the first video hierarchy are stored into the video hierarchy and semantic representation database as part of the hierarchically managed video clip pool, and the semantic vector space comprises areas associated with each of the one or more referenceable terms, and the semantic representation of each of the first video and the first video clips are stored in respective ones of the areas of the semantic vector space based on a level of similarity between the semantic representation and the one or more referenceable terms;
replacing, using the level of similarity, each of the one or more referenceable terms within the response with a hyperlink to a video, among the videos stored in the hierarchically managed video clip pool, to obtain an enhanced response; and
providing the enhanced response to the user.