US 11,685,052 B2
Vision guided robot arm and method for operating the same
Louis-Joseph Caron L'Ecuyer, Boisbriand (CA); Jean-Francois Forget, Boisbriand (CA); Jonathan Lussier, Boisbriand (CA); and Sébastien Boisvert, Boisbriand (CA)
Assigned to Kinova Inc., Boisbriand (CA)
Filed by Kinova Inc., Boisbriand (CA)
Filed on Sep. 18, 2019, as Appl. No. 16/574,673.
Claims priority of provisional application 62/732,708, filed on Sep. 18, 2018.
Prior Publication US 2020/0086493 A1, Mar. 19, 2020
Int. Cl. B25J 9/16 (2006.01); H04N 13/207 (2018.01); G06V 20/20 (2022.01); H04N 23/45 (2023.01); H04N 23/54 (2023.01)
CPC B25J 9/1697 (2013.01) [B25J 9/1664 (2013.01); G06V 20/20 (2022.01); H04N 13/207 (2018.05); H04N 23/45 (2023.01); H04N 23/54 (2023.01); G06V 2201/06 (2022.01)] 30 Claims
OG exemplary drawing
 
1. A method for operating a vision guided robot arm system comprising a robot arm provided with an end effector at a distal end thereof, a display, an image sensor and a controller, the method comprising:
receiving from the image sensor an initial image of an area comprising at least one object and displaying the initial image on the display;
determining, by the controller, an object of interest amongst the at least one object and identifying the object of interest within the initial image;
determining, by the controller, a potential action to be performed by a user, the potential action being related to the object of interest and providing the user with an identification of the potential action;
receiving a confirmation of the object of interest and the potential action from the user;
after said receiving the confirmation of the object of interest and the potential action, automatically moving the robot arm so as to position the end effector of the robot arm at a predefined position relative to the object of interest; and
once the end effector is positioned at the predefined position, allowing the user to control the robot arm to perform the potential action.