US 12,459,130 B2
Robot operation system, robot operation method, and program
Shun Sato, Nagoya (JP)
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed by TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed on Sep. 14, 2023, as Appl. No. 18/467,296.
Claims priority of application No. 2022-167574 (JP), filed on Oct. 19, 2022.
Prior Publication US 2024/0131717 A1, Apr. 25, 2024
Prior Publication US 2024/0227195 A9, Jul. 11, 2024
Int. Cl. B25J 9/16 (2006.01)
CPC B25J 9/1697 (2013.01) 6 Claims
OG exemplary drawing
 
1. A robot operation system comprising:
a composite image generation unit to which Computer-Aided Design (CAD) data of an object and a workpiece and a feature point of the workpiece are input, the composite image generation unit being configured to generate a plurality of composite images under random conditions from the CAD data of the object and the workpiece;
an information processing apparatus configured to search for a route using a position of an end effector of a robot and a position of the feature point and move the end effector to the feature point along the searched route; and
an imaging apparatus configured to photograph the end effector of the robot, the object and the workpiece, wherein
the information processing apparatus comprises a memory unit configured to store a trained machine learner trained using a plurality of input training datasets, each of the training datasets being composed of a combination of each composite image and the position of the feature point,
the information processing apparatus is configured to output the position of the feature point in response to an input of a photographed image of the workpiece to the trained machine learner read from the memory unit, and
the information processing apparatus uses an image of the end effector and the feature point photographed by the imaging apparatus to search for the route.