US 12,094,067 B2
Machine fastening work method using augmented reality
Gojiro Yamaguchi, Tokyo (JP); Shogo Nakata, Kyoto (JP); Yusuke Hirai, Kyoto (JP); Na Yang, Tokyo (JP); Yuta Tanida, Tokyo (JP); and Norihisa Okada, Tokyo (JP)
Assigned to HITACHI, LTD., Tokyo (JP)
Appl. No. 17/908,957
Filed by HITACHI, LTD., Tokyo (JP)
PCT Filed Mar. 5, 2020, PCT No. PCT/JP2020/009378
§ 371(c)(1), (2) Date Sep. 2, 2022,
PCT Pub. No. WO2021/176645, PCT Pub. Date Sep. 10, 2021.
Prior Publication US 2023/0104917 A1, Apr. 6, 2023
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01)
CPC G06T 19/006 (2013.01) [G02B 2027/014 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A mechanical fastening work method, by a first worker, using an augmented reality space generated by overlapping a virtual space on real space,
the real space including a mechanical fastening part and a tool put on the mechanical fastening part,
the virtual space including a mechanical fastening part virtual body simulating the mechanical fastening part and a tool virtual body simulating the tool virtual body,
in the augmented reality space, the mechanical fastening part corresponding one-to-one to the mechanical fastening part virtual body and the tool corresponding one-to-one with the tool virtual body,
an augmented reality system that generates the augmented reality space having:
a camera that captures the real space,
a server that is connected to the camera and is configured to analyze an image captured by the camera and generate an augmented reality space, and
the tool that obtains tightening/loosening information observed at a time of tightening or loosening for the mechanical fastening part and transmits and receives the tightening/loosening information to and from the server,
the mechanical fastening work method comprising:
a step of defining the mechanical fastening part virtual body that corresponds one-to-one to the mechanical fastening part virtual body, and having the defined mechanical fastening part virtual body appear in the virtual space, when the tool has detected the tightening/loosening information for tightening or loosening the mechanical fastening part;
a step of creating a first work table that is generated on a basis of fastening work by the first worker and has position information for the mechanical fastening part and the tightening/loosening information; and
projecting the position information held in the first work table into the augmented reality space, and teaching work content by the first worker to a second worker.