US 12,020,434 B2
Segmentation and view guidance in ultrasound imaging and associated devices, systems, and methods
Alvin Chen, Cambridge, MA (US); Kunal Vaidya, Boston, MA (US); Brian Lee, Rockville, MD (US); Vipul Shrihan Pai Raikar, Somerville, MA (US); Mingxin Zheng, Cambridge, MA (US); Shyam Bharat, Arlington, MA (US); and Ameet Kumar Jain, Boston, MA (US)
Assigned to KONINKLIJKE PHILIPS N.V., Eindhoven (NL)
Appl. No. 17/599,590
Filed by KONINKLIJKE PHILIPS N.V., Eindhoven (NL)
PCT Filed Mar. 30, 2020, PCT No. PCT/EP2020/058898
§ 371(c)(1), (2) Date Sep. 29, 2021,
PCT Pub. No. WO2020/201183, PCT Pub. Date Oct. 8, 2020.
Claims priority of provisional application 62/964,715, filed on Jan. 23, 2020.
Claims priority of provisional application 62/828,185, filed on Apr. 2, 2019.
Prior Publication US 2022/0198669 A1, Jun. 23, 2022
Int. Cl. A61B 34/20 (2016.01); A61B 8/00 (2006.01); A61B 8/08 (2006.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 7/20 (2017.01); G06T 7/70 (2017.01)
CPC G06T 7/0016 (2013.01) [A61B 8/0841 (2013.01); A61B 8/461 (2013.01); A61B 8/483 (2013.01); A61B 34/20 (2016.02); G06T 7/11 (2017.01); G06T 7/20 (2013.01); G06T 7/70 (2017.01); A61B 2034/2063 (2016.02); G06T 2207/10132 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30048 (2013.01); G06T 2207/30101 (2013.01)] 15 Claims
OG exemplary drawing
 
1. An ultrasound imaging system comprising:
a processor circuit in communication with an ultrasound imaging device, the processor circuit configured to:
receive, from the ultrasound imaging device, a temporal sequence of input image frames of a moving object over a time period, wherein the moving object comprises at least one of an anatomy of a patient or a medical device traversing through the patient's anatomy, and wherein a portion of the moving object is at least partially invisible in a first input image frame of the sequence of input image frames;
apply a recurrent predictive network associated with image segmentation to the sequence of input image frames to generate segmentation data, wherein the recurrent predictive network is adapted to predict motion and/or positions of the moving object based on temporal information carried in the sequence of image frames, and wherein the recurrent predictive network comprises a deep learning network adapted to pass a prediction for a current image frame as an input for a prediction of a next image frame; and
output, to a display in communication with the processor circuit, a sequence of output image frames based on the segmentation data, wherein the portion of the moving object is fully visible in a first output image frame of the sequence of output image frames, the first output image frame and the first input image frame associated with a same time instant within the time period.
 
15. A non-transitory computer-readable storage medium having stored thereon a computer program including instructions for configuring a processor circuit to control an ultrasound imaging device, in which the instructions, when executed by the processor circuit, cause the processor circuit to:
receive, from the ultrasound imaging device, a temporal sequence of image frames representative of an anatomy of a patient over a time period;
apply a recurrent predictive network associated with image acquisition to the sequence of image frames to generate imaging plane data associated with a clinical property of the patient's anatomy, wherein the recurrent predictive network is adapted to predict motion and/or positions of the anatomy of the patient based on temporal information carried in the sequence of image frames, and wherein the recurrent predictive network comprises a deep learning network adapted to pass a prediction for a current image frame as an input for a prediction of a next image frame; and
output to a display at least one of a target imaging plane of the patient's anatomy or an instruction for repositioning the ultrasound imaging device towards the target imaging plane.