US 12,272,056 B1
Stable visualization of tubular objects by the fly-in method with applications to computed tomography colonography
Aly Farag, Louisville, KY (US); and Salwa Elshazly, Louisville, KY (US)
Assigned to Kentucky Imaging Technologies, LLC, Louisville, KY (US)
Filed by Kentucky Imaging Technologies, LLC, Louisville, KY (US)
Filed on Aug. 30, 2022, as Appl. No. 17/899,185.
Claims priority of provisional application 63/239,982, filed on Sep. 2, 2021.
Int. Cl. G06T 7/00 (2017.01); G06T 15/08 (2011.01); G06T 17/20 (2006.01)
CPC G06T 7/0012 (2013.01) [G06T 15/08 (2013.01); G06T 17/20 (2013.01); G06T 2207/10072 (2013.01); G06T 2207/30028 (2013.01)] 5 Claims
OG exemplary drawing
 
1. A method for transforming three-dimensional (3D) visualization data from a tubular object into a planar image, wherein the method comprises:
a. Acquiring, from at least one rig of virtual cameras, a plurality of images that provide 360° visualization of a cylindrical region of interest (ROI), wherein the rig of virtual cameras is positioned on a centerline, and wherein the images define a cylindrical ring mesh and wherein the images comprise at least one look-at vector (look) and at least one view-up vector (up);
b. Unfolding the 3D tubular object by maintaining constant look and up vectors without regard to camera position;
c. Fitting a generalized cylinder to each cylindrical ring mesh, wherein each cylindrical ring mesh has at least one mesh vertex;
d. Computing rotation minimizing frames (RMF) to generate a set of initial director frames defined by axes {T(s), U(s), V(s)};
e. Parametrizing each mesh vertex by (s, σ), wherein s is a value and 0≤s≤1, and wherein σ is given by the rotation angle of α vector vi−c(s) about T(s) measured about the U(s) axis, wherein vi is a mesh vertex of the cylindrical ring mesh and c(s) is a parametrized line modeled for the cylindrical ring mesh;
f. Defining a first torsion energy before unfolding and defining a second torsion energy after unfolding;
g. Calculating a torsion energy differential by using the first torsion energy and the second torsion energy;
h. Using an optimization method to find a 3D mesh that satisfies the smallest torsion energy differential and transforming the centerline to conform with the 3D mesh;
i. Establishing a path for camera rig movement along the transformed centerline such that the virtual camera has a translation parallel to the centerline, wherein the path is defined as a plurality of neighboring positions along the centerline;
j. Moving the camera rig to the neighboring position along the path;
k. Repeating steps (a)-(i) until camera stabilization is reached, and generating a composite planar image of the tubular object.