US 12,243,210 B2
Maintenance support system, maintenance support method, program, method for generating processed image, and processed image
Takeshi Habe, Hyogo (JP); and Norihiro Tsujioka, Hyogo (JP)
Assigned to SPP TECHNOLOGIES, CO., LTD., Tokyo (JP)
Appl. No. 17/053,829
Filed by SPP TECHNOLOGIES CO., LTD., Tokyo (JP)
PCT Filed Mar. 19, 2020, PCT No. PCT/JP2020/012325
§ 371(c)(1), (2) Date Nov. 9, 2020,
PCT Pub. No. WO2020/196276, PCT Pub. Date Oct. 1, 2020.
Claims priority of application No. PCT/JP2019/012279 (WO), filed on Mar. 22, 2019; and application No. PCT/JP2019/027986 (WO), filed on Jul. 16, 2019.
Prior Publication US 2022/0012868 A1, Jan. 13, 2022
Int. Cl. G06K 9/00 (2022.01); G02B 27/01 (2006.01); G06T 7/00 (2017.01)
CPC G06T 7/0004 (2013.01) [G02B 27/017 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G06T 2207/30204 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A maintenance support system comprising:
a wearable terminal including an imaging device and worn by a maintenance worker;
a first identifying device configured to identify a predetermined first three-dimensional area including industrial equipment that is a maintenance target, by using a SLAM technique and/or to identify a predetermined second three-dimensional area excluding the industrial equipment that is the maintenance target, by using the SLAM technique, with reference to a predetermined reference point in a captured image acquired by the imaging device in an initial state;
a second identifying device configured to identify a mask voxel area excluding an effective voxel area corresponding to the first three-dimensional area, by using the SLAM technique and/or to identify a mask voxel area corresponding to the second three-dimensional area, in a captured image acquired by the imaging device, by using the SLAM technique in a post-movement state in which the wearable terminal has moved;
a processed-image generating device configured to generate a processed image in which the mask voxel area identified by the second identifying device is made invisible for the captured image acquired by the imaging device in the post-movement state; and
a communication device configured to transmit the processed image generated by the processed-image generating device to a support terminal operated by a maintenance supporter,
wherein the second identifying device is configured to identify the mask voxel area excluding the effective voxel area corresponding to the first three-dimensional area and/or to identify the mask voxel area corresponding to the second three-dimensional area even if the reference point is not included in the captured image acquired by the imaging device in the post-movement state.