US 11,775,766 B2
Method and apparatus for improving model based on pre-trained semantic model
Xuyi Chen, Beijing (CN); and Shiwei Huang, Beijing (CN)
Assigned to BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD., Beijing (CN)
Filed by BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD., Beijing (CN)
Filed on Mar. 10, 2021, as Appl. No. 17/249,718.
Claims priority of application No. 202010555885.7 (CN), filed on Jun. 17, 2020.
Prior Publication US 2021/0397794 A1, Dec. 23, 2021
Int. Cl. G06F 40/30 (2020.01); G06N 3/08 (2023.01); G06N 3/045 (2023.01)
CPC G06F 40/30 (2020.01) [G06N 3/045 (2023.01); G06N 3/08 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A method for improving a model based on a pre-trained semantic model, the method comprising:
obtaining, based on the pre-trained semantic model, an initial improved model, wherein semantic result information of an input vector is determined in the initial improved model based on a hash search method; and
training, based on a model distillation method, the initial improved model to obtain an improved model, wherein determining the semantic result information of the input vector in the initial improved model based on the hash search method comprises:
obtaining, based on a fully connected layer, a transformation vector of the input vector in the initial improved model; and
determining a target position corresponding to the transformation vector in a hash storage module storing semantic information according to the hash search method, and using semantic information stored in the target position as the semantic result information of the input vector.