Robot assistance for detecting, managing, and mitigating risk

Patent metadata

Field	Value
Publication number	US-9348336-B2
Application number	US-201414485544-A
Country	US
Kind code	B2
Filing date	Sep 12, 2014
Priority date	Sep 12, 2014
Publication date	May 24, 2016
Grant date	May 24, 2016

Abstract

The disclosure includes a system and method for using a robot to prevent risk to a user by identifying a point of interest, determining whether the point of interest is a risk for the user with visual impairments based on the user's position, responsive to a first predetermined threshold for distance being met, determining where to move the robot to mitigate the risk to the user, and instructing the robot to move to a new location. The robot may move between the user and the point of interest to prevent the user from colliding with the point of interest. The robot may use an auditory or tactile warning to warn the user. The tactile warning may be transmitted to a walking stick or a belt worn by the user.

First claim

What is claimed is:

1. A method for a robot, comprising:
identifying, with one or more processors, a point of interest;
determining whether the point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met, determining a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence being met, determining where to move the robot to mitigate risk to the user; and
instructing the robot to move to a new location.

2. The method of claim 1 , further comprising estimating a degree of risk based on risk factors by assigning a score to the point of interest based on a path associated with the user.

3. The method of claim 1 , further comprising:
determining whether to warn the user; and
responsive to determining to warn the user, providing a warning to the user.

4. The method of claim 3 , wherein the warning is at least one of an auditory warning and a tactile warning.

5. The method of claim 3 , wherein the warning is a tactile warning and further comprising transmitting the warning to a walking stick that provides the user with haptic feedback.

6. The method of claim 1 , further comprising:
determining whether to warn the user; and
responsive to determining not to warn the user, identifying a second point of interest.

7. The method of claim 1 , further comprising responsive to a second predetermined threshold for confidence failing to be met, identifying a second point of interest.

8. The method of claim 1 , wherein the point of interest comprises at least one of a drop, a fixed obstacle, and a mobile object.

9. A computer program product for a robot comprising a non-transitory computer-usable medium including a computer-readable program, wherein the computer-readable program when executed on a computer causes the computer to:
identify a point of interest;
determine whether the point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met, determining a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence being met, determining where to move the robot to mitigate risk to the user; and
instruct the robot to move to a new location.

10. The computer program product of claim 9 , wherein the computer-readable program is further configured to estimate a degree of risk based on risk factors by assigning a score to the point of interest based on a path associated with the user.

11. The computer program product of claim 9 , wherein the computer-readable program is further configured to:
determining whether to warn the user; and
responsive to determining to warn the user, providing a warning to the user.

12. The computer program product of claim 11 , wherein the warning is at least one of an auditory warning and a tactile warning.

13. The computer program product of claim 11 , wherein the warning is a tactile warning and further comprising transmitting the warning to a walking stick that provides the user with haptic feedback.

14. A system for a robot, comprising:
a processor; and
a memory storing instructions that, when executed, cause the system to:
identify a point of interest;
determine whether the point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met, determine a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence being met, determine where to move the robot to mitigate risk to the user; and
instruct the robot to move to a new location.

15. The system of claim 14 , wherein the memory is further configured to estimate a degree of risk based on risk factors by assigning a score to the point of interest based on a path associated with the user.

16. The system of claim 15 , wherein the memory is further configured to:
determining whether to warn the user; and
responsive to determining to warn the user, providing a warning to the user.

17. The system of claim 16 , wherein the warning is at least one of an auditory warning and a tactile warning.

18. The system of claim 16 , wherein the warning is a tactile warning and further comprising transmitting the warning to a walking stick that provides the user with haptic feedback.

19. A method comprising:
identifying, with one or more processors, a first point of interest;
determining whether the first point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met for the first point of interest, determining a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence failing to be met, identifying a second point of interest;
determining whether the second point of interest is a risk for the user with visual impairments based on the user's position;
responsive to the first predetermined threshold for distance being met for the second point of interest, determining where to move a robot to mitigate the risk to the user; and
instructing the robot to move to a new location.

20. A computer program product comprising a non-transitory computer-usable medium including a computer-readable program, wherein the computer-readable program when executed on a computer causes the computer to:
identify a first point of interest;
determine whether the first point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met for the first point of interest, determine a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence failing to be met, identify a second point of interest;
determine whether the second point of interest is a risk for the user with visual impairments based on the user's position;
responsive to the first predetermined threshold for distance being met for the second point of interest, determine where to move a robot to mitigate the risk to the user; and
instruct the robot to move to a new location.

21. A system comprising:
a processor; and
a memory storing instructions that, when executed, cause the system to:
identify a first point of interest;
determine whether the first point of interest is a risk for a user with visual impairments based on the user's position;
responsive to a first predetermined threshold for distance failing to be met for the first point of interest, determine a confidence factor that indicates a likelihood of actual risk;
responsive to a second predetermined threshold for confidence failing to be met, identify a second point of interest;
determine whether the second point of interest is a risk for the user with visual impairments based on the user's position;
responsive to the first predetermined threshold for distance being met for the second point of interest, determine where to move a robot to mitigate the risk to the user; and
instruct the robot to move to a new location.

Assignees

• Toyota Motor Co Ltd

Inventors

• Sisbot Emrah Akin

Classifications

• A61H2201/1635

  Hand or arm, e.g. handle · CPC title

• A61H2201/5012

  using the internet · CPC title

• A61H3/068

  Sticks for blind persons · CPC title

• A61H2201/5058

  Sensors or detectors · CPC title

• H04W8/02

  Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks · CPC title