Systems and methods for configurable operation of a robot based on area classification

Patent metadata

Field	Value
Publication number	US-10168709-B2
Application number	US-201715704814-A
Country	US
Kind code	B2
Filing date	Sep 14, 2017
Priority date	Sep 14, 2016
Publication date	Jan 1, 2019
Grant date	Jan 1, 2019

Abstract

A method of operating a mobile robot includes generating a segmentation map defining respective regions of a surface based on occupancy data that is collected by a mobile robot responsive to navigation of the surface, identifying sub-regions of at least one of the respective regions as non-clutter and clutter areas, and computing a coverage pattern based on identification of the sub-regions. The coverage pattern indicates a sequence for navigation of the non-clutter and clutter areas, and is provided to the mobile robot. Responsive to the coverage pattern, the mobile robot sequentially navigates the non-clutter and clutter areas of the at least one of the respective regions of the surface in the sequence indicated by the coverage pattern. Related methods, computing devices, and computer program products are also discussed.

First claim

That which is claimed is:

1. A computing device, comprising:
a processor; and
a memory coupled to the processor, the memory comprising a non-transitory computer-readable storage medium storing computer-readable program code therein that is executable by the processor to perform operations comprising:
generating a segmentation map defining respective regions of a surface based on occupancy data that is collected by a mobile robot responsive to navigation of the surface, wherein the segmentation map comprises simplified boundaries relative to actual boundaries indicated by the occupancy data;
identifying sub-regions of at least one of the respective regions as non-clutter and clutter areas;
modifying the segmentation map comprising the simplified boundaries to indicate the clutter areas responsive to identification thereof;
computing a coverage pattern based on identification of the sub-regions, the coverage pattern indicating a sequence for navigation of the non-clutter and clutter areas;
and
providing the coverage pattern to the mobile robot,

wherein, responsive to the coverage pattern, the mobile robot sequentially navigates the non-clutter and clutter areas of the at least one of the respective regions of the surface in the sequence indicated by the coverage pattern.

2. The computing device of claim 1 , wherein the sequence further comprises navigation of a perimeter of the surface, and wherein the mobile robot sequentially navigates the non-clutter area, the clutter area, and the perimeter of the surface in the sequence indicated by the coverage pattern.

3. The computing device of claim 1 , wherein the coverage pattern further indicates a rank direction for the non-clutter area, the rank direction corresponding to a dimension of the at least one of the respective regions that is longer than another dimension thereof, and wherein the mobile robot traverses the non-clutter area in the rank direction indicated by the coverage pattern.

4. The computing device of claim 3 , wherein computing the coverage pattern comprises:
determining a location on the surface for ending the navigation of the non-clutter area based on a proximity to the clutter area,
wherein, responsive to traversing the non-clutter area in the rank direction indicated by the coverage pattern, the mobile robot ends the navigation of the non-clutter area at the location having the proximity to the clutter area and traverses the clutter area in a different pattern while avoiding obstacles in the clutter area.

5. The computing device of claim 1 , wherein the respective regions defined by the segmentation map correspond to respective rooms, wherein the coverage pattern further indicates an order of navigation of the respective rooms, and wherein the mobile robot sequentially navigates the non-clutter and clutter areas of one of the respective rooms in the sequence indicated by the coverage pattern before navigation of a next one of the respective rooms in the order indicated by the coverage pattern.

6. The computing device of claim 1 , wherein the operations further comprise:
providing the segmentation map to a user device, the user device comprising a user interface that is configured to display the segmentation map; and
receiving, from the user device, a selection input responsive to providing the segmentation map thereto,
wherein computing the coverage pattern is further based on the selection input.

7. The computing device of claim 6 , wherein the selection input comprises respective levels of cleaning for the at least one of the respective regions and/or the sub-regions thereof, wherein the coverage pattern further indicates the respective levels of cleaning, and wherein the mobile robot executes a number of cleaning passes in navigating the at least one of the respective regions and/or the sub-regions thereof according to the respective levels of cleaning indicated by the coverage pattern.

8. The computing device of claim 6 , wherein the selection input comprises a user-defined boundary or label for one or more of the respective regions and/or sub-regions thereof, wherein the coverage pattern further indicates the user-defined boundary or label, and wherein the mobile robot avoids navigation of the one or more of the respective regions and/or sub-regions thereof according to the user-defined boundary or label indicated by the coverage pattern.

9. The computing device of claim 1 , wherein the operations further comprise:
detecting respective flooring types of the sub-regions,
wherein computing the coverage pattern further comprises determining the sequence for navigation of the non-clutter and clutter areas based on the respective flooring types of the sub-regions corresponding thereto.

10. The computing device of claim 1 , wherein the segmentation map comprises data previously received from a user device and/or collected by the mobile robot responsive to at least one previous navigation of the surface.

11. The computing device of claim 10 , wherein generating the segmentation map comprises:
comparing the occupancy data collected by the mobile robot responsive to the navigation of the surface with the data collected by the mobile robot responsive to the at least one previous navigation of the surface; and
updating the segmentation map to include commonalities indicated by the comparing and to exclude outliers indicated by the comparing.

12. The computing device of claim 1 , wherein generating the segmentation map comprises:
computing a binary image based on the occupancy data by applying a thresholding function; and
performing a watershed transformation on the binary image to partition the binary image into the respective regions by applying a distance transform.

13. The computing device of claim 1 , wherein the modifying the segmentation map comprising the simplified boundaries to indicate the clutter areas responsive to the identification thereof is prior to providing the segmentation map to a user device.

14. The computing device of claim 1 , wherein identifying the sub-regions as non-clutter and clutter areas comprises:
accessing a data store comprising a plurality of patterns and identifications thereof; and
classifying pixel regions within the sub-regions based on similarities to the plurality of patterns stored in the data store.

15. The computing device of claim 14 , wherein one or more of the identifications of the plurality of patterns are based on respective labeling inputs received from one or more user devices.

16. The computing device of claim 15 , wherein identifying the sub-regions as non-clutter and clutter areas further comprises:
classifying the pixel regions as static structures corresponding to walls or dynamic structures corresponding to clutter responsive to accessing the data store.

17. The computing device of claim 14 , wherein identifying the sub-regions as non-clutter and clutter areas comprises:
identifying at least one boundary based on the occupancy data; and
prior to accessing the data store, distinguishing the pixel regions as attached pixel regions that are adjacent to at least one boundary and detached pixel regions that are spaced apart from the at least one boundary.

18. The computing device of claim 1 , wherein the computing device comprises a component of the mobile robot, wherein the occupancy data is detected by at least one sensor of the mobile robot, and wherein the operations further comprise:
operating a drive of the mobile robot to sequentially navigate the non-clutter and clutter areas of the at least one of the re

Assignees

• Irobot Corp

Inventors

• Kleiner Alexander D
• Munich Mario E

Classifications

• A47L9/2857

  User input or output elements for control, e.g. buttons, switches or displays · CPC title

• A47L11/4011

  Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor · CPC title

• Y10S901/01

  Mobile robot · CPC title

• A47L9/2894

  Details related to signal transmission in suction cleaners · CPC title

• A47L9/2852

  Elements for displacement of the vacuum cleaner or the accessories therefor, e.g. wheels, casters or nozzles · CPC title