US 12,454,061 B2
System and method for operating the robot, electronic device and computer readable medium
Yichao Mao, Shanghai (CN); and Xinyu Fang, Shanghai (CN)
Assigned to ABB Schweiz AG, Baden (CH)
Appl. No. 17/758,869
Filed by ABB Schweiz AG, Baden (CH)
PCT Filed Jan. 22, 2020, PCT No. PCT/CN2020/073906
§ 371(c)(1), (2) Date Jul. 14, 2022,
PCT Pub. No. WO2021/147035, PCT Pub. Date Jul. 29, 2021.
Prior Publication US 2023/0032982 A1, Feb. 2, 2023
Int. Cl. B25J 9/16 (2006.01); B25J 13/08 (2006.01); G05B 19/042 (2006.01)
CPC B25J 9/1697 (2013.01) [B25J 13/08 (2013.01); G05B 19/042 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system for operating a robot, comprising:
a processor; and
a non-transitory computer readable media having stored thereon instructions that are executable by the processor to perform operations comprising:
determine, by a first data collector coupled to the robot, a first position information of the robot based on feedback data received from a controller of the robot;
determine, by a second data collector coupled to a sensor, a second position information of an object to be operated by the robot based on sensing data received from the sensor, wherein the sensor and the robot are arranged in an operating environment;
generate, by a first estimator coupled to the first data collector and the second data collector based on the first position information and the second position information, a first prediction of a target position at which the object is operated by the robot, wherein the first estimator is further configured to:
record the sensing data including a time stamp representative of a receipt of each sensor data;
calibrate a first set of time stamps of the first position information and a second set of time stamps of the second position information based on a predetermined time delay between the time stamp each sensor data is received from the sensor and a sampled time point of each sensor data by the sensor; and
generate the first prediction of the target position by fusing a first set of sampled parameters from the first position information and a second set of sampled parameters from the second position information based on a fusion mode associated with an expected operation to be performed by the robot; and
generate, by a command generator coupled to the first estimator, a command for operating the robot at least partially based on the first prediction;
wherein the sensor is spaced apart from the robot in the operating environment.