Spatial guidance system for visually impaired individuals

Patent metadata

Field	Value
Publication number	US-11599194-B2
Application number	US-202016882399-A
Country	US
Kind code	B2
Filing date	May 22, 2020
Priority date	May 22, 2020
Publication date	Mar 7, 2023
Grant date	Mar 7, 2023

Abstract

Method, systems, and apparatus to facilitate navigation in a known environment. Communication and tracking between a receiver device and one or more beacons are provided to identify a current position of the receiver device. A direction to a next waypoint of a current path is determined based on the identified current position and a haptic feedback system is signaled to provide continuous haptic feedback to orient a user in the identified direction.

First claim

What is claimed is:

1. A method to facilitate navigation in a known environment, the method comprising:
providing communication and tracking between a receiver device and one or more beacons to identify a current position of the receiver device;
determining a direction to a next waypoint of a current path based on the identified current position;
signaling a haptic feedback system to provide continuous haptic feedback to orient a user in the identified direction; and
controlling one or more motors to generate actuation in opposite directions to create a rotational pivot about a fixed axis of a cane to orient the user towards a direction of the next waypoint.

2. The method of claim 1 , further comprising identifying the current path by analyzing a movement of the user in the known environment.

3. The method of claim 1 , wherein the next waypoint is at least one of a closest reference point, a starting reference point of the current path, a last reference point encountered by the user, a default reference point, and a reference point specified by the user.

4. The method of claim 1 , further comprising placing the one or more beacons in one or more fixed locations in the known environment, each beacon to be used as a static waypoint that transmits navigation signals to the receiver device.

5. The method of claim 1 , further comprising using a triangulation technique to detect a position of the user at a non-beacon waypoint and using the detected location to guide the user to the next waypoint.

6. The method of claim 1 , further comprising training a disorientation model based on location data for the user during one or more journeys and using the disorientation model to determine if the user appears disoriented.

7. The method of claim 6 , wherein the disorientation detection model automatically detects when passive haptic signals are ignored, the method further comprising disengaging a haptic feedback system in response to detecting that the passive haptic signals are being ignored.

8. The method of claim 1 , further comprising detecting a disorientation of the user by analyzing a movement of the user in relation to the current path.

9. The method of claim 1 , wherein the haptic feedback system is engaged in response to a user actively indicating disorientation.

10. The method of claim 1 , wherein the haptic feedback system is engaged in response to a passive detection of disorientation of the user.

11. The method of claim 1 , wherein the determining operation is at least partially performed in a cloud environment.

12. The method of claim 1 , further comprising applying tension to a back side and/or a front side of each suspender of a pair of suspenders, responsive to the signaling.

13. The method of claim 12 , wherein both suspenders are tensioned toward the front side to indicate that the next waypoint is in front of the user, both suspenders are tensioned toward the back side to indicate that the next waypoint is behind the user, the left suspender is tensioned toward the back side and the right suspender is tensioned toward the front side to indicate that the next waypoint is towards a left side of the user, and the right suspender is tensioned toward the back side and the left suspender is tensioned toward the front side to indicate that the next waypoint is towards a right side of the user.

14. The method of claim 1 , wherein the haptic feedback system identifies the next waypoint using short haptic feedback patterns.

15. The method of claim 1 , further comprising, responsive to the signaling, providing the continuous haptic feedback to orient the user in the identified direction.

16. A system comprising:
a haptic feedback system configured to provide haptic feedback to a user; and
a smart device in communication with the haptic feedback system and configured to:
provide communication and tracking between a receiver device and one or more beacons to identify a current position of the receiver device;
determine a direction to a next waypoint of a current path based on the identified current position; and
signal the haptic feedback system to provide continuous haptic feedback to orient the user in the identified direction, wherein the haptic feedback system comprises a pair of suspenders and one or more motors coupled to the suspenders, the one or more motors configured to tension each suspender at one or more of a back side and a front side.

17. A system comprising:
a haptic feedback system configured to provide haptic feedback to a user; and
a smart device in communication with the haptic feedback system and configured to:
provide communication and tracking between a receiver device and one or more beacons to identify a current position of the receiver device;
determine a direction to a next waypoint of a current path based on the identified current position; and
signal the haptic feedback system to provide continuous haptic feedback to orient the user in the identified direction, wherein the haptic feedback system comprises a cane and one or more motors coupled to the cane, the one or more motors providing actuation in opposite directions to create a rotational pivot about a fixed axis of the cane to orient the user towards a direction of the next waypoint.

Assignees

• IBM

Inventors

• Byamugisha Joan
• Young Richard Allen
• Kurien Toby
• Khan Naweed Aghmad
• Molapo Maletsabisa

Classifications

• G08B6/00

  Tactile signalling systems, e.g. tactile personal calling systems · CPC title

• G01C21/3652

  Guidance using non-audiovisual output, e.g. tactile, haptic or electric stimuli · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• A61H3/068

  Sticks for blind persons · CPC title

• A61H2201/5097

  wireless · CPC title