US 12,308,099 B2
Extended reality medical report generating system
Michael J. Docktor, Boston, MA (US); Kate Donovan, Boston, MA (US); Yan Fossat, Ontario (CA); and John S. Brownstein, Boston, MA (US)
Assigned to Children's Medical Center Corporation, Boston, MA (US)
Filed by Children's Medical Center Corporation, Boston, MA (US); and Klick Inc., Ontario (CA)
Filed on Aug. 25, 2020, as Appl. No. 17/002,221.
Application 17/002,221 is a continuation of application No. PCT/US2019/019598, filed on Feb. 26, 2019.
Claims priority of provisional application 62/635,355, filed on Feb. 26, 2018.
Prior Publication US 2020/0388363 A1, Dec. 10, 2020
Int. Cl. G16H 15/00 (2018.01); G06F 21/62 (2013.01); G06T 11/00 (2006.01); G09B 23/28 (2006.01); G09B 23/30 (2006.01); G16H 10/60 (2018.01); G16H 50/50 (2018.01)
CPC G16H 15/00 (2018.01) [G06F 21/6245 (2013.01); G06T 11/00 (2013.01); G09B 23/28 (2013.01); G09B 23/30 (2013.01); G16H 10/60 (2018.01); G16H 50/50 (2018.01); G06T 2210/41 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method for creating a representative tour medical report, the method comprising:
receiving an electronic medical record comprising medical findings from a procedure for a specific patient from a medical records server;
receiving medical imaging data corresponding to a body part or tract associated with the medical findings from a medical records server;
outputting, at an output device of a healthcare provider device, a virtual reality visualization screen for the body part or tract comprising a plurality of interface elements within an outline of the body part or tract, the outline of the body part or tract comprising a plurality of peg elements in the plurality of interface elements;
receiving, at a user input device of the healthcare provider device, one or more selections of the plurality of peg elements for configuring the representative tour medical report, the one or more selections mapping the medical findings to one or more selected peg elements in the plurality of peg elements, wherein a particular medical finding is mapped to a particular selected peg element by a user positioning an icon representing a condition associated with the particular medical finding onto the particular selected peg element, wherein each peg element may only contain one condition and if the user attempts to position the icon onto a peg element that is already occupied, the icon being positioned is prevented from being placed onto the peg element that is already occupied;
determining the one or more conditions associated with the medical findings mapped to the one or more selected peg elements of the plurality of peg elements;
generating the representative tour medical report by:
generating one or more denoted locations in the medical imaging data correlated to the one or more selected peg elements based on the medical findings associated with the medical imaging data;
generating a three-dimensional visual representation of an anatomy associated with the body part or tract, the three-dimensional visual representation comprising a geometry based at least on the medical imaging data and the one or more selected peg elements;
generating one or more denoted condition segments within the three-dimensional visual representation by painting a texture onto the geometry at the one or more denoted locations based on the one or more conditions;
generating a two-dimensional overlay of the three-dimensional visual representation of the anatomy, the overlay comprising at least one selected from the group of:
one or more annotations of the medical findings; and
the outline of the body part or tract;
storing, upon the configuring, the representative tour medical report linked to a patient identifier (ID) of the specific patient; and
generating a computer-readable access code encoding the patient ID configured to enable the specific patient, upon scanning the computer-readable access code, to access and view the representative tour medical report.