Interfacing with a mobile telepresence robot

Patent metadata

Field	Value
Publication number	US-11830618-B2
Application number	US-202217694348-A
Country	US
Kind code	B2
Filing date	Mar 14, 2022
Priority date	Jan 28, 2011
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a plan view map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a plan view map, or by using a joystick or other peripheral device.

First claim

What is claimed is:

1. A telepresence robot comprising:
a drive system configured to move the telepresence robot about a facility according to one or more drive instructions;
a control system in communication with the drive system, the control system configured to generate the one or more drive instructions;
an imaging system in communication with the control system;
a mapping module in communication with the control system, the mapping module configured to access a map data source, the map data source comprising:
a robot map of robot-navigable areas of the facility;
at least one tag comprising:
tag coordinates that identify a region within the robot-navigable areas of the facility, and
a robot action modifier that provides instructions to a control system of the telepresence robot to execute a behavior when the telepresence robot is within a predetermined range of the tag coordinates of the region identified by the at least one tag; and
a destination list including destination locations within the facility, each destination location comprising spatial coordinates locatable relative to the robot map;

a positioning system in communication with the control system configured to provide positioning information associated with a current position;
a communication system configured to provide a video feed from the imaging system to a remote terminal and receive control commands from the remote terminal, and wherein the control system is configured to generate the one or more drive instructions according to a control command received from the remote terminal, wherein the control command is generated by the remote terminal in response to a user input at the remote terminal; and
a navigation system configured to generate a navigation path from the current position to a selected destination location, wherein the drive system moves the telepresence robot along the navigation path and, when the telepresence robot is within the predetermined range of the tag coordinates of a particular tag, the robot action modifier for the particular tag provides instructions to the control system of the telepresence robot to execute the behavior associated with the particular tag.

2. The telepresence robot of claim 1 , wherein the user input includes selecting a movement of the telepresence robot from the current position to a destination location via one of a plurality of options on a single user interface, the plurality of options comprising:
selecting a velocity-based control specifying a direction of the movement of the telepresence robot;
selecting the destination location of the telepresence robot with respect to the destination list; and
selecting the destination location of the telepresence robot with respect to the video feed.

3. The telepresence robot of claim 1 , further comprising:
a plurality of sensors configured to identify obstacles in proximity to the telepresence robot; and
an obstacle avoidance system in communication with the plurality of sensors and in communication with the control system, wherein the control system is further configured to generate additional drive instructions to avoid obstacles in proximity to the telepresence robot.

4. The telepresence robot of claim 1 , further comprising:
a map generation system in communication with the control system, the map generation system configured to autonomously create the robot map, and wherein the control system generates drive instructions to cause the telepresence robot to move throughout the facility and obtain a plurality of measurements, and the map generation system uses the plurality of measurements to generate the robot map.

5. The telepresence robot of claim 1 , wherein the control system is further configured to transmit coordinates relative to the robot map of a detected obstacle to the remote terminal via the communication system.

6. The telepresence robot of claim 1 , wherein the control system is further configured to receive a navigation path from the current position on the robot map to a destination location on the robot map, and wherein the control system is further configured to generate drive instructions to cause the drive system to move the telepresence robot to the destination location based on the navigation path.

7. The telepresence robot of claim 1 , wherein the communication system is configured to detect a disruption in communication between the telepresence robot and a remote terminal, and wherein the control system is further configured to continue to generate drive instructions to cause the telepresence robot to autonomously move to a destination location during the disruption in communication.

8. The telepresence robot of claim 1 , wherein the region associated with the particular tag relates to at least one of a position, a path, and a volume, and wherein the control system is configured to execute an action relative to the at least one of the position, the path, and the volume.

9. The telepresence robot of claim 1 , wherein the map data source is stored remotely, such that the mapping module is configured to access the map data source via the communication system.

10. The telepresence robot of claim 1 , wherein the map data source is stored within the telepresence robot, such that the mapping module is configured to access an internal map data source.

11. The telepresence robot of claim 10 , wherein the internal map data source is synced with a remotely stored map data source.

12. The telepresence robot of claim 1 , wherein the positioning system is further configured to provide a robot pose relative to the robot map.

13. The telepresence robot of claim 1 , wherein the telepresence robot is configured to create a new tag by:
associating tag coordinates describing a relative location of the new tag with respect to one of the robot map and the video feed generated by the imaging system; and associating tag information with the new tag.

14. The telepresence robot of claim 13 , wherein the new tag is created in response to the telepresence robot detecting an object in the video feed.

15. The telepresence robot of claim 14 , wherein the object is a person and the tag information of the new tag comprises identification information associated with the person.

16. The telepresence robot of claim 1 , wherein the at least one tag indicates a driving hazard or obstacle to be avoided by telepresence robot.

17. The telepresence robot of claim 16 , wherein the driving hazard includes an area of having a glass wall, window, or door that that interferes with infrared proximity sensors of the telepresence robot.

18. The telepresence robot of claim 16 , wherein the driving hazard includes an area of relatively poor wireless signal reception compared to other areas represented by the robot map.

19. The telepresence robot of claim 1 , wherein the at least one tag indicates a robot aid usable by the telepresence robot.

20. The telepresence robot of claim 19 , wherein the robot aid corresponding to the at least one tag placed by a user includes one of a ramp and an autonomously navigable elevator.

Assignees

• Intouch Tech Inc
• Irobot Corp
• Teladoc Health Inc

Inventors

• Wang Yulun
• Jordan Charles S
• Wright Tim
• Chan Michael
• Pinter Marco
• Hanrahan Kevin
• Sanchez Daniel
• Ballantyne James
• Herzog Cody
• Whitney Blair
• Lai Fuji
• Temby Kelton
• Rauhut Eben Christopher
• Kearns Justin H
• Wong Cheuk Wah
• Farlow Timothy Sturtevant

Classifications

• G16H40/67 Primary

  for remote operation · CPC title

• G05D1/622

  Obstacle avoidance (predicting or avoiding probable or impending collision of road vehicles B60W30/08) · CPC title

• G05D1/246

  using environment maps, e.g. simultaneous localisation and mapping [SLAM] · CPC title

• G05D1/244

  using passive navigation aids external to the vehicle, e.g. markers, reflectors or magnetic means · CPC title

• H04N7/142

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title