US 11,989,841 B2
Operation system for industrial machinery
Nao Onose, Yamanashi (JP)
Assigned to FANUC CORPORATION, Yamanashi (JP)
Appl. No. 17/799,715
Filed by FANUC CORPORATION, Yamanashi (JP)
PCT Filed Feb. 17, 2021, PCT No. PCT/JP2021/005982
§ 371(c)(1), (2) Date Aug. 15, 2022,
PCT Pub. No. WO2021/166973, PCT Pub. Date Aug. 26, 2021.
Claims priority of application No. 2020-025897 (JP), filed on Feb. 19, 2020.
Prior Publication US 2023/0062991 A1, Mar. 2, 2023
Int. Cl. G06T 15/00 (2011.01); G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06T 19/00 (2011.01)
CPC G06T 19/006 (2013.01) [G06F 3/017 (2013.01); G06F 3/0346 (2013.01)] 5 Claims
OG exemplary drawing
 
1. An operation system for industrial machinery, the operation system comprising:
an information acquisition unit that acquires machine identification information corresponding to an industrial machine;
a machine identification unit that identifies the industrial machine based on the machine identification information acquired by the information acquisition unit;
a model projection unit that projects a model corresponding to the industrial machine identified by the machine identification unit into a virtual space;
a distance-direction calculation unit that calculates, in the virtual space, (i) a distance between a user observing the model and the model projected by the model projection unit, and (ii) and a direction of the user observing the model with respect to the model projected by the model projection unit;
a gesture observation unit that observes a gesture of the user as an instruction from the user for the industrial machine identified by the machine identification unit;
an instruction determination unit that determines whether the user can give the instruction based on the distance and the direction of the user calculated by the distance-direction calculation unit and the gesture of the user observed by the gesture observation unit; and
an operation instruction unit that, when a determination result of the instruction determination unit is positive, operates the industrial machine specified by the machine identification unit based on the gesture of the user observed by the gesture observation unit.