CPC B25J 9/1661 (2013.01) [B25J 9/1664 (2013.01); B25J 9/1689 (2013.01); B25J 13/089 (2013.01); B25J 19/023 (2013.01); G05D 1/0038 (2013.01); G05D 1/0044 (2013.01); G05D 1/0251 (2013.01); G05D 1/0274 (2013.01); G06F 3/0486 (2013.01); G06F 3/04847 (2013.01)] | 30 Claims |
1. A method for authoring tasks for execution by a programmable mobile robot in a physical environment, the method comprising:
at an application running on a mobile device with augmented reality simultaneous localization and mapping (AR-SLAM) capabilities, the mobile device comprising a processor, a memory, a network interface for communications via one or more wired or wireless computer networks, a camera for recording images captured within a field-of-view (FOV) of a display of the mobile device, and one or more sensors for estimating motion of the camera in the physical environment:
generating a dynamic simultaneous localization and mapping (SLAM) map comprising spatial information for an augmented reality (AR) scene that comprises a digital representation of at least part of the physical environment in a 3-dimensional coordinate system;
displaying the AR scene in the display of the mobile device;
receiving input defining a pathway through which the programmable mobile robot is to navigate in the physical environment wherein the pathway is defined based on recording spatial movements of the mobile device in the physical environment using one or more of the sensors on the mobile device;
generating a task sequence comprising routing instructions to be executed by the programmable mobile robot for navigation in the physical environment based on the input defining the pathway through which the robot is to navigate in the physical environment;
transferring the task sequence from the mobile device to the programmable mobile robot wherein the programmable mobile robot is adapted to execute the routing instructions to generate control signals for controlling robot navigation in the physical environment, wherein the physical environment includes a distribution of one or more Internet of Things (IoT) devices and wherein the one or more IoT devices are spatially registered within the dynamic SLAM map and serve as landmarks for the programmable mobile robot to navigate in the AR scene; and
docking with IoT devices using functions of the mobile device camera wherein functions of the one or more IoT devices are configured to be edited in-situ in the AR scene.
|