	US 12,235,436 B2
	Plenoptic endoscope with fiber bundle
Azad Shademan, Campbell, CA (US)
Assigned to Intuitive Surgical Operations, Inc., Sunnyvale, VA (US)
Filed by Intuitive Surgical Operations, Inc., Sunnyvale, CA (US)
Filed on Oct. 18, 2022, as Appl. No. 18/047,489.
Application 18/047,489 is a division of application No. 16/365,514, filed on Mar. 26, 2019, granted, now 11,503,987.
Claims priority of provisional application 62/648,060, filed on Mar. 26, 2018.
Prior Publication US 2023/0062628 A1, Mar. 2, 2023
Int. Cl. G02B 23/24 (2006.01); A61B 1/00 (2006.01); A61B 1/005 (2006.01); A61B 1/04 (2006.01); A61B 1/06 (2006.01); H04N 23/957 (2023.01); A61B 5/00 (2006.01); G02B 13/00 (2006.01)

CPC G02B 23/2469 (2013.01) [A61B 1/00009 (2013.01); A61B 1/00096 (2013.01); A61B 1/0016 (2013.01); A61B 1/00165 (2013.01); A61B 1/00188 (2013.01); A61B 1/00193 (2013.01); A61B 1/00194 (2022.02); A61B 1/009 (2022.02); A61B 1/04 (2013.01); A61B 1/0676 (2013.01); H04N 23/957 (2023.01); A61B 5/0075 (2013.01); G02B 13/0015 (2013.01); G02B 23/2484 (2013.01)]

20 Claims

1. A method of presenting a visualization of a target imaging region on a display of a plenoptic endoscope, the method comprising:

receiving, at an image sensor of the plenoptic endoscope, light from a target imaging region;

computing, based on an output of the image sensor, a photographic image of a portion of the target imaging region;

computing, based on the output of the image sensor, a depth map associated with the portion of the target imaging region;

generating a three-dimensional (3D) surface representation of the portion of the target imaging region based on the computed depth map; and

presenting the visualization of the target imaging region on the display, the visualization of the target imaging region comprising the photographic image of the portion of the target imaging region with the 3D surface representation projected on the photographic image of the portion of the target imaging region.