US 12,014,495 B2
Generating reports from scanned images
Ozan Oktay, London (GB); Javier Alvarez-Valle, Cambridge (GB); Melanie Bernhardt, Cambridge (GB); Daniel Coelho De Castro, Cambridge (GB); Shruthi Jaisimha Bannur, Cambridge (GB); Anton Schwaighofer, Cambridge (GB); Aditya Nori, Cambridge (GB); and Hoifung Poon, Redmond, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Sep. 24, 2021, as Appl. No. 17/484,882.
Prior Publication US 2023/0102428 A1, Mar. 30, 2023
Int. Cl. G06T 7/00 (2017.01); G06F 3/04842 (2022.01); G06F 40/166 (2020.01); G06N 20/00 (2019.01); G06T 11/00 (2006.01); G06T 11/20 (2006.01)
CPC G06T 7/0012 (2013.01) [G06F 3/04842 (2013.01); G06F 40/166 (2020.01); G06N 20/00 (2019.01); G06T 11/001 (2013.01); G06T 11/203 (2013.01); G06T 2207/10088 (2013.01); G06T 2207/10104 (2013.01); G06T 2207/10116 (2013.01); G06T 2207/10132 (2013.01); G06T 2207/20081 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer implemented method comprising:
receiving a current report on a condition of a human or animal subject, the current report comprising text composed by a user based on examining one or more scans of the subject, each of the one or more scans comprising at least one image of at least part of the subject;
receiving the one or more scans;
inputting the current report and the one or more scans into a trained machine learning model, the machine learning model being pre-trained based on a plurality of past scans and corresponding reports composed based on the past scans, the past scans comprising at least some scans of other subjects;
based on the current report and the one or more scans of the subject, the machine learning model generating one or more suggestions for updating the text of the report; and
outputting data to cause a user interface to display to the user one or more suggestions for updating the text of the current report, with each respective suggestion visually linked in the user interface to a corresponding subregion within at least one image of at least one of the one or more scans based upon which the respective suggestion was generated.