US 12,466,074 B2
Image processing method, image processing apparatus, robot-mounted transfer device, and system
Yuta Oba, Nara (JP); Tsutomu Sakurai, Hokkaido (JP); Hideki Nagasue, Nara (JP); Masaaki Nakagawa, Nara (JP); Hideaki Tanaka, Nara (JP); Kota Weaver, Lexington, MA (US); and Anand Parwal, Lexington, MA (US)
Assigned to DMG MORI CO., LTD., Nara (JP); and Movensys Corporation
Filed by DMG MORI CO., LTD., Nara (JP); and Movensys Corporation, Somerville, MA (US)
Filed on Oct. 30, 2020, as Appl. No. 17/085,285.
Prior Publication US 2022/0134577 A1, May 5, 2022
Int. Cl. B25J 9/00 (2006.01); B25J 9/16 (2006.01)
CPC B25J 9/1697 (2013.01) 5 Claims
OG exemplary drawing
 
1. An image processing method of processing an image captured by a camera of a robot-mounted transportation device, the transportation device including: (i) the camera capturing the image; (ii) a robot having the camera attached thereto and having an acting part acting on a target object; (iii) a moving device having the robot mounted thereon and configured to be movable; and (iv) a controller controlling a position of the acting part, the image processing method comprising:
an opening step of opening a door cover of a machine tool to expose an internal structure of the machine tool;
a positioning step of moving the moving device to an operation position set with respect to the machine tool, and then stopping the moving device at the operation position;
a first calculation step of causing the camera to capture a first image of an internal structure in a machining area of the machine tool with the machine tool open, and, with the moving device stopped at the operation position of the moving device when capturing the first image, analyzing the captured first image and calculating a current position of the camera based on analysis of the internal structure in the first image;
a first control step of controlling motion of the robot to move the camera from the current position of the camera to a preset position of the camera with the machine tool open, with the moving device stopped at the operating position of the moving device;
a second calculation step of, after moving the camera at the same position of the moving device, causing the camera to capture a second image of the internal structure with the machine tool open, analyzing the internal structure in the captured second image, and calculating a current position of the acting part; and
a second control step of controlling motion of the robot to move the acting part from the current position of the acting part to a preset position of the target object or a preset position to which the target object is to be transported with the machine tool open.