US 12,423,601 B2
Systems and methods for analysis explainability
Nadja Herger, Thalwil (CH); Nina Stamenova Hristozova, Langnau Am Albis (CH); Milda Norkute, Zurich (CH); Leszek Michalak, Zug (CH); Stavroula Skylaki, Zug (CH); Daniele Giofré, Tolochenaz (CH); and Andrew Timothy Mulder, Orleans (CA)
Assigned to Thomson Reuters Enterprise Centre GmbH, Zug (CH)
Filed by Thomson Reuters Enterprise Centre GmbH, Zug (CH)
Filed on Sep. 24, 2021, as Appl. No. 17/484,881.
Claims priority of provisional application 63/082,779, filed on Sep. 24, 2020.
Prior Publication US 2022/0092453 A1, Mar. 24, 2022
Int. Cl. G06F 17/00 (2019.01); G06F 16/23 (2019.01); G06N 5/045 (2023.01)
CPC G06N 5/045 (2013.01) [G06F 16/2379 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method of displaying attention scores to a user, comprising:
receiving a source document to be analyzed by at least one model, wherein the source document includes a plurality of tokens, and wherein the at least one model is configured to generate a summary based on content of the source document, and wherein the summary includes a plurality of tokens;
determining one or more attention scores for each token of the plurality of tokens of the source document with respect to each token of the plurality of tokens of the summary, wherein each attention score of the one or more attention scores indicates a level of relevance of an associated token of the source document to an associated token of the summary generated by the at least one model;
determining, based on the one or more attention scores, averaged attention scores for each token of the plurality of tokens of the source document with respect to the plurality of tokens of the summary;
aligning each token of the plurality of tokens of the source document to at least one word of a plurality of words included in the source document;
combining, for each word of the plurality of words included in the source document, averaged attention scores of tokens aligned to the word to generate an overall attention score for each word of the plurality of words included in the source document; and
displaying at least one word of the plurality of words included in the source document with an indication of the overall attention score associated with the at least one word, the indication based on the overall attention score.