US 11,997,056 B2
Language model with external knowledge base
Sumit Bhatia, New Delhi (IN); Jivat Neet Kaur, Delhi (IN); Rachit Bansal, New Delhi (IN); Milan Aggarwal, Delhi (IN); and Balaji Krishnamurthy, Noida (IN)
Assigned to ADOBE INC., San Jose, CA (US)
Filed by ADOBE INC., San Jose, CA (US)
Filed on Aug. 29, 2022, as Appl. No. 17/897,419.
Prior Publication US 2024/0073159 A1, Feb. 29, 2024
Int. Cl. H04L 51/02 (2022.01); G06F 40/295 (2020.01); G06N 5/022 (2023.01)
CPC H04L 51/02 (2013.01) [G06F 40/295 (2020.01); G06N 5/022 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving a natural-language sequence of words comprising multiple entities, wherein the entities comprise persons and places;
identifying a plurality of entities in the natural-language sequence;
generating a masked natural-language sequence by masking a first entity in the natural-language sequence;
generating a first representation of the masked natural-language sequence, wherein the first representation is a machine embedding of the masked natural-language sequence;
retrieving, from a knowledge base, information related to a second entity in the plurality of entities;
generating a second representation of the information; and
training a natural-language model to respond to a query, wherein the training uses the first representation of the masked natural-language sequence and the second representation of the information as inputs and the first entity as a training label.