| CPC G06T 7/75 (2017.01) [G06T 2207/10116 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20121 (2013.01); G06T 2207/20124 (2013.01); G06T 2207/30008 (2013.01)] | 15 Claims |
|
1. A system for determining a 3D representation and localization of an object in an X-ray projection image with respect to a coordinate system, the system comprising a processing unit configured to execute a computer program product including sets of instructions causing the system to perform the following method:
receiving one X-ray projection image, the X-ray projection image comprising an image characteristic including a pillow effect,
classifying an object in the X-ray projection image,
receiving a model of the classified object,
determining a 3D representation of the classified object based on the X-ray projection image of the object and on the model of the classified object, and
localizing the classified object with respect to the coordinate system, by applying the model to match the classified object in the X-ray image, wherein the step of localizing comprises determining of a 3D orientation of the object with respect to the coordinate system and determining of a 2D spatial position of a projection of the object onto a projection plane of the X-ray projection image, wherein matching of the model with the classified object takes into account the image characteristic of the X-ray projection image;
providing aspects of the 3D representation and localization of the classified object, as determined based on the X-ray projection image, as a priori information; and
performing at least one of a transparent visualization or a 3D reconstruction of the classified object based on the 3D representation and the localization of the classified object.
|