US 12,072,496 B2
Information processing device, control method, and storage medium
Yasunori Babazaki, Tokyo (JP); Akane Aruga, Tokyo (JP); and Katsumi Kikuchi, Tokyo (JP)
Assigned to NEC CORPORATION, Tokyo (JP)
Appl. No. 17/783,450
Filed by NEC Corporation, Tokyo (JP)
PCT Filed Dec. 24, 2019, PCT No. PCT/JP2019/050628
§ 371(c)(1), (2) Date Jun. 8, 2022,
PCT Pub. No. WO2021/130860, PCT Pub. Date Jul. 1, 2021.
Prior Publication US 2023/0011625 A1, Jan. 12, 2023
Int. Cl. G02B 27/01 (2006.01); G06T 7/70 (2017.01)
CPC G02B 27/0172 (2013.01) [G06T 7/70 (2017.01)] 11 Claims
OG exemplary drawing
 
1. An information processing device comprising:
at least one memory configured to store instructions; and
at least one processor configured to execute the instructions to:
input a captured image captured by a camera of a display device configured to display a virtual object superimposed on a view to an identifier;
acquire multiple combinations of classification information of a structural feature point that is a feature point, in structure, of a target structure and position information of the structural feature point, wherein
the multiple combinations are output from the identifier in response to input of the captured image,
the captured image includes plural structural feature points of the target structure, and the identifier has learned a relation between an image which includes the plural structural feature points, and a position and a class of each of the plural structural feature points; and
generate coordinate transformation information by matching structure data with the multiple combinations, wherein
the structure data includes information associated with the position and the class of each of the plural structural feature points of the target structure, and
the coordinate transformation information relates to a coordinate transformation between a first coordinate system that is a coordinate system referred to by the display device and a second coordinate system that is a coordinate system adopted in the structure data,
wherein when one axis of the first coordinate system is equivalent to one axis of the second coordinate system, the at least one processor is configured to execute the instructions to generate the coordinate transformation information by matching the multiple combinations relating to at least two of the plural structural feature points with the structure data, and
wherein when any axis of the first coordinate system is different from any axis of the second coordinate system, the at least one processor is configured to execute the instructions to generate the coordinate transformation information by matching the multiple combinations relating to at least three of the plural structural feature points and the structure data.