US 12,376,722 B2
Robotic cleaner
Robert T. Hall, Franklin, TN (US); Alex Irkliy, Portland, TN (US); and Heena Mordani, Brookline, MA (US)
Assigned to SharkNinja Operating LLC, Needham, MA (US)
Filed by SHARKNINJA OPERATING LLC, Needham, MA (US)
Filed on Aug. 12, 2022, as Appl. No. 17/886,877.
Claims priority of provisional application 63/232,997, filed on Aug. 13, 2021.
Prior Publication US 2023/0046417 A1, Feb. 16, 2023
Int. Cl. A47L 11/40 (2006.01); G05D 1/00 (2024.01)
CPC A47L 11/4011 (2013.01) [G05D 1/0038 (2013.01); G05D 1/0044 (2013.01); G05D 1/0274 (2013.01); A47L 2201/04 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A robotic cleaning system comprising:
a robotic cleaner configured to generate a map of an environment; and
a mobile device configured to communicatively couple to the robotic cleaner, the robotic cleaner configured to communicate the map to the mobile device, wherein the mobile device includes:
a camera configured to generate an image of the environment, the image comprising a plurality of pixels;
a display configured to display the image and to receive a user input while displaying the image, the user input being associated with one or more of the plurality of pixels;
a depth sensor configured to generate depth data that is associated with each pixel of the image;
an orientation sensor configured to generate orientation data that is associated with each pixel of the image; and
a mobile controller configured to localize the mobile device within the map received from the robotic cleaner using the depth data and the orientation data;
wherein the mobile controller is configured to recognize an object within the image;
wherein the mobile controller localizes the recognized object within the map received from the robotic cleaner using the depth data and the orientation data;
wherein the display is configured to display an augmented reality element associated with the recognized object.