US 12,263,596 B2
Autonomous and semi-autonomous control of aerial robotic systems
Jonathan Westin Sykes, Gower, MO (US); Timothy J. Mourlam, Shawnee, KS (US); David Lindquist, Cameron, MO (US); William Naber, Saint Joseph, MO (US); and Robert Nichols, Saint Joseph, MO (US)
Assigned to Altec Industries, Inc., Birmingham, AL (US)
Filed by Altec Industries, Inc., Birmingham, AL (US)
Filed on Apr. 18, 2023, as Appl. No. 18/135,941.
Application 18/135,941 is a continuation of application No. 17/875,710, filed on Jul. 28, 2022, granted, now 11,660,750.
Prior Publication US 2024/0033916 A1, Feb. 1, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. B25J 9/16 (2006.01)
CPC B25J 9/1664 (2013.01) [B25J 9/161 (2013.01); B25J 9/163 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A robot system for performing cooperative tasks in an operational environment of an aerial device, the robot system comprising:
at least one processor;
a robot unit disposed at a boom tip comprising at least one manipulator configured to perform a task in the operational environment;
a tool configured to attach to the at least one manipulator and perform the task;
a camera for obtaining images of the operational environment;
a sensor associated with the robot unit;
a head-up display configured to display a user interface;
an input device associated with a user and communicatively coupled to the robot unit; and
one or more non-transitory computer-readable media storing computer-readable instructions that, when executed by the at least one processor, perform a method comprising:
obtaining, by the camera, data indicative of a location of an object in the operational environment;
obtaining sensor data from the sensor,
autonomously performing the task using the tool and based at least in part on the sensor data and the data indicative of the location of the object;
displaying, by the head-up display, an indicia at a task location for performing the task and further displaying option labels for an identification of a component;
receiving input from the user by the input device,
wherein the input is either one of a designation of the task location for performing the task or the identification of the component in the operational environment;
updating the task based on the input from the user; and
performing the updated task based at least in part on the sensor data and the input from the user.