Time-dependent navigation of telepresence robots

Patent metadata

Field	Value
Publication number	US-9785149-B2
Application number	US-201615139073-A
Country	US
Kind code	B2
Filing date	Apr 26, 2016
Priority date	Jan 28, 2011
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a map, or by using a joystick or other peripheral device.

First claim

What is claimed is:

1. A telepresence robot, comprising:
a drive system configured to move the telepresence robot according to drive instructions;
a control system in communication with the drive system, the control system configured to generate the drive instructions to cause the drive system to move the telepresence robot along a navigation path;
a mapping module in communication with the control system, the mapping module configured to access a map data source, the map data source including:
a robot map representative of a robot operating surface; and
one or more time-dependent navigation tags, each time-dependent navigation tag being a data structure comprising:
spatial coordinates locatable relative to the robot map and associated with the robot operating surface; and
tag information comprising a time-dependent robot action modifier;

a positioning system in communication with the control system configured to provide positioning information associated with a current position;
a tag identification system configured to identify at least one time-dependent navigation tag that includes a time-dependent robot action modifier associated with the navigation path of the telepresence robot; and
a navigation system configured to generate the navigation path, the navigation path comprising a sequence of coordinates from the current position on the robot map to a desired position on the robot map,
wherein the navigation system is configured to be triggered by an identified time-dependent navigation tag and associated time-dependent robot action modifier to plan the navigation path based, at least in part, on the time-dependent robot action modifier associated with the identified time-dependent navigation tag.

2. The telepresence robot of claim 1 , wherein the navigation system is configured to generate the navigation path by generating a plurality of potential navigation paths, wherein each potential navigation path has an associated cost based on the time-dependent robot action modifiers associated with the time-dependent navigation tags along the respective potential navigation path; and
selecting the navigation path from the plurality of potential navigation path based on the associated cost.

3. The telepresence robot of claim 1 , further comprising:
a plurality of sensors configured to identify obstacles in a vicinity of the telepresence robot; and
an obstacle avoidance system in communication with the plurality of sensors and in communication with the control system, wherein the control system is further configured to generate additional drive instructions to avoid obstacles in the vicinity of the telepresence robot.

4. The telepresence robot of claim 3 , wherein the plurality of sensors comprises a three-dimensional image sensor that forms a point cloud, including a three-dimensional occupancy of obstacles, and
wherein the drive instructions are configured to avoid the three-dimensional occupancy of the obstacles.

5. The telepresence robot of claim 1 , further comprising a plurality of sensors monitoring time-dependent obstacles, time-dependent environmental conditions and time-dependent occupancy conditions, wherein the plurality of sensors are mounted on the telepresence robot and in remote communication with the telepresence robot.

6. The telepresence robot of claim 5 , wherein the telepresence robot is configured to create a time-dependent navigation tag based on information from the plurality of sensors and time of day information.

7. The telepresence robot of claim 1 , wherein the map data source is stored remotely, such that the mapping module is configured to access the map data source via a communication system.

8. The telepresence robot of claim 1 , wherein the map data source is stored within the telepresence robot, such that the mapping module is configured to access an internal map data source.

9. The telepresence robot of claim 8 , wherein the internal map data source is synced with a remotely stored map data source.

10. The telepresence robot of claim 1 , wherein the positioning system comprises an RFID reader,
wherein the positioning system associates a plurality of RFID chips with a corresponding plurality of coordinates on the plan view robot map, and the positioning system is configured to determine the current position of the telepresence robot based at least in part on a location of one or more RFID chips within range of the RFID reader.

11. A method for controlling a telepresence robot, comprising:
retrieving at least a portion of a robot map;
retrieving at least one of one or more time-dependent navigation tags, each time-dependent navigation tag represented by a data structure including:
tag coordinates describing a location of the at least one of one or more time-dependent navigation tag relative to the robot map; and
cost information associated with navigating in the relative location of the time-dependent navigation tag during a time period;

determining a current position of a telepresence robot relative to the robot map;
generating a navigation path comprising a sequence of coordinates from the current position to a desired position on the robot map, wherein generating the navigation path includes:
generating a plurality of potential navigation paths, wherein each potential navigation path has an associated cost based on time-dependent navigation tags associated with the respective potential navigation path, wherein each time-dependent navigation tag comprises a time-dependent robot action modifier configured to trigger a response action by a telepresence robot during a time period; and
selecting a navigation path from the plurality of potential navigation paths based on the associated cost.

Assignees

• Irobot Corp
• Intouch Tech Inc

Inventors

• Wang Yulun
• Jordan Charles S
• Wright Tim
• Chan Michael
• Pinter Marco
• Hanrahan Kevin
• Sanchez Daniel
• Ballantyne James
• Herzog Cody
• Whitney Blair
• Lai Fuji
• Temby Kelton
• Rauhut Eben Christopher
• Kearns Justin H
• Wong Cheuk Wah
• Farlow Timothy Sturtevant

Classifications

• B25J9/1689

  Teleoperation · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• B25J11/009

  Nursing, e.g. carrying sick persons, pushing wheelchairs, distributing drugs · CPC title

• G05D1/0274

  using mapping information stored in a memory device (navigation using map-matching G01C21/30) · CPC title

• G05D1/0261

  using magnetic plots · CPC title