US 12,260,345 B2
Multimodal knowledge consumption adaptation through hybrid knowledge representation
Marcio Ferreira Moreno, Rio de Janeiro (BR); Rafael Rossi de Mello Brandao, Rio de Janeiro (BR); and Renato Fontoura de Gusmão Cerqueira, Rio de Janeiro (BR)
Assigned to International Business Machines Corporation, Armonk, NY (US)
Filed by International Business Machines Corporation, Armonk, NY (US)
Filed on Oct. 29, 2019, as Appl. No. 16/666,747.
Prior Publication US 2021/0125086 A1, Apr. 29, 2021
Int. Cl. G09B 7/02 (2006.01); G06F 3/048 (2013.01); G06F 8/30 (2018.01); G06F 16/903 (2019.01); G06F 16/9035 (2019.01); G06F 16/93 (2019.01); G06N 3/082 (2023.01); G06N 5/02 (2023.01); G06N 5/04 (2023.01)
CPC G06N 5/04 (2013.01) [G06F 16/903 (2019.01); G06F 16/90335 (2019.01); G06F 16/9035 (2019.01); G06N 3/082 (2013.01); G06N 5/02 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of generating and using a multimodal knowledge representation within an artificial intelligence computing system, the method comprising:
prompting, via one or more processors, a selection of nodes in a graphical visualization;
defining an adaptation strategy comprising a user profile component stored in a memory coupled to the one or more processors;
integrating, via the one or more processors, an adaptation strategy representation with the selection of nodes to generate a multimodal knowledge representation;
traversing the selection of nodes in response to a user query to register a traversal result;
performing an adaptation on the selection of nodes based on the traversal result;
displaying, via a display device, a result generated in response to the user query;
receiving user feedback on the result generated in response to the user query, the user feedback indicating a user profession, wherein a meaning applied to one or more terms by the user profession is different than an alternative meaning applied to the one or more terms by a different profession; and
in response to the user feedback, updating, via the one or more processors, the adaptation strategy to reflect the meaning applied to the one or more terms by the user profession;
performing an updated adaption on at least one selection of nodes based on the updated adaptation strategy, wherein the updated adaptation causes at least one node unrelated to the meaning applied to the one or more terms by the user profession to be removed from the multimodal knowledge representation, and the at least one node that is removed from the multimodal knowledge representation is related to the alternative meaning applied to the one or more terms by the different profession.