US 12,292,926 B2
Surgical video retrieval based on preoperative images
Martin Habbecke, Palo Alto, CA (US); Joëlle K. Barral, Mountain View, CA (US); Lin Yang, Sunnyvale, CA (US); and Xing Jin, San Jose, CA (US)
Assigned to Verily Life Sciences LLC, Dallas, TX (US)
Filed by Verily Life Sciences LLC, South San Francisco, CA (US)
Filed on Apr. 10, 2023, as Appl. No. 18/132,769.
Application 18/132,769 is a continuation of application No. 16/299,965, filed on Mar. 12, 2019, granted, now 11,657,087.
Claims priority of provisional application 62/644,737, filed on Mar. 19, 2018.
Prior Publication US 2023/0252075 A1, Aug. 10, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/783 (2019.01); A61B 34/10 (2016.01); A61B 34/20 (2016.01); A61B 90/00 (2016.01); G06F 16/71 (2019.01); G06N 3/08 (2023.01); G06N 20/00 (2019.01); G06V 10/70 (2022.01); G09B 23/28 (2006.01); G16H 10/60 (2018.01); G16H 20/40 (2018.01); G16H 30/20 (2018.01); G06T 7/00 (2017.01); G16H 30/40 (2018.01); G16H 50/70 (2018.01)
CPC G06F 16/7837 (2019.01) [A61B 34/10 (2016.02); A61B 34/20 (2016.02); A61B 90/37 (2016.02); G06F 16/71 (2019.01); G06F 16/7847 (2019.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01); G06V 10/70 (2022.01); G09B 23/28 (2013.01); G16H 10/60 (2018.01); G16H 20/40 (2018.01); G16H 30/20 (2018.01); G06T 7/0012 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30004 (2013.01); G16H 30/40 (2018.01); G16H 50/70 (2018.01)] 20 Claims
OG exemplary drawing
 
13. A method, comprising:
receiving a search query including an input medical image and weighted parameters;
receiving, with a processor coupled to memory, a plurality of first medical images different from the input medical image;
generating, with the processor, respective feature vectors describing the plurality of first medical images using a machine learning algorithm configured to receive pixel-level information of the plurality of first medical images included in the memory,
weighting positionally common elements included in the respective feature vectors associated with the plurality of first medical images and a corresponding feature vector associated with the input medical image based on the weighted parameters;
calculating, with the processor, similarity scores for the plurality of first medical images relative to the input medical image, wherein the similarity scores correspond to a comparison between the respective feature vectors associated with the plurality of first medical images and the corresponding feature vector associated with the input medical image after the weighting;
filtering the plurality of first medical images based on the similarity scores, wherein the filtering includes filtering out a first portion of the plurality of first medical images outside a similarity score threshold range for relevancy from the plurality of first medical images by selecting for display a second portion of the plurality of first medical images within the similarity score threshold range for relevancy; and
outputting a relative rank for the second portion of the plurality of first medical images based on the similarity scores after the filtering.