US 11,055,873 B2
Composite image generation system and position information correction system
Bo Zhang, Tokyo (JP); Kui Chen, Tokyo (JP); Weiyi Cai, Tokyo (JP); and Shunichi Tano, Tokyo (JP)
Assigned to TCC MEDIA LAB CO., LTD, Tokyo (JP)
Appl. No. 17/45,874
Filed by TCC Media Lab CO., LTD., Chofu (JP)
PCT Filed Feb. 1, 2019, PCT No. PCT/JP2019/003744
§ 371(c)(1), (2) Date Oct. 7, 2020,
PCT Pub. No. WO2020/157984, PCT Pub. Date Aug. 6, 2020.
Prior Publication US 2021/0142509 A1, May 13, 2021
Int. Cl. G06T 7/73 (2017.01); G06T 19/00 (2011.01); H04N 5/272 (2006.01); G01B 7/004 (2006.01); G01P 15/18 (2013.01); A61B 8/00 (2006.01); A61B 8/08 (2006.01); A61B 5/00 (2006.01); A61B 5/06 (2006.01); G06T 7/246 (2017.01)
CPC G06T 7/73 (2017.01) [A61B 5/0035 (2013.01); A61B 5/0077 (2013.01); A61B 5/064 (2013.01); A61B 8/463 (2013.01); A61B 8/5261 (2013.01); G01B 7/004 (2013.01); G01P 15/18 (2013.01); G06T 7/246 (2017.01); G06T 19/006 (2013.01); H04N 5/272 (2013.01); A61B 2562/0219 (2013.01); A61B 2562/0223 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30204 (2013.01); G06T 2210/41 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A composite image generation system comprising: a position information detection device that detects position information about a predetermined spot in a real space; and a processing device that generates a composite image in which a separately acquired superimposed image is overlaid onto a desired region in a camera image of the real space captured by a movably placed camera, based on the position information detected by the position information detection device, wherein
the position information detection device comprises an optical tracking means that detects the position information by using the camera image, and a non-optical tracking means that detects the position information without using the camera,
the optical tracking means comprises a moving optical marker that is affixed to a moving member that specifies the desired region while moving inside the real space according to any operations by a user, the moving optical marker being configured to move as one with the moving member, and an optical marker detection unit that detects position information about the moving optical marker by recognizing an image state of the moving optical marker captured by the camera,
the non-optical tracking means comprises a non-optical marker affixed to the moving member, and a non-optical marker detection unit that detects position information about the non-optical marker,
the processing device includes a position information specifying means that adjusts detection results from the optical tracking means and the non-optical tracking means to specify position information about the moving member used when superimposing the superimposed image onto the desired region, and
the position information specifying means comprises a recognition state determination unit that determines a recognition state of the moving optical marker by the camera, a used information selection unit that selects which position information to use from among the detection results from the optical tracking means and the non-optical tracking means according to the recognition state of the moving optical marker, and an output position information decision unit that decides output position information necessary to generate the composite image according to the position information selected by the used information selection unit.