Assistive mechanism via edge device personalization

Patent metadata

Field	Value
Publication number	US-11525684-B2
Application number	US-201916690663-A
Country	US
Kind code	B2
Filing date	Nov 21, 2019
Priority date	Nov 21, 2019
Publication date	Dec 13, 2022
Grant date	Dec 13, 2022

Abstract

A method, system, and computer program product provide navigation guidance around various object types in a vicinity of a guidance assistance device for a user by analyzing received data regarding an environment around the guidance assistance device to identify one or more entities Ei and by applying an artificial intelligence machine learning analysis to group the one or more entities Ei into corresponding categories Cj and to determine a minimum spacing distance Dmin for each of the one or more entities Ei, wherein the minimum spacing distance Dmin is a minimum distance between the guidance assistance device and the entity Ei based on the categorization Ci specified by the user, and then providing feedback to the user when any of the one or more entities Ei is within than minimum spacing distance Dmin corresponding to said entity.

First claim

What is claimed is:

1. A computer-implemented method for navigation guidance around various object types in a vicinity of a guidance assistance device for a user, the method comprising:
receiving, by a first information handling system comprising a processor and a memory, data regarding an environment around the guidance assistance device;
analyzing, by the first information handling system, the data regarding the environment around the guidance assistance device to identify one or more entities E (E1, E2, . . . Ei) and corresponding detected distances D (D1, D2, . . . Di) between the guidance assistance device and the one or more entities E (E1, E2, . . . Ei);
applying an artificial intelligence (AI) machine learning analysis to group the one or more entities E (E1, E2, . . . Ei) into corresponding categories C (C1, C2, . . . Cj) and to determine a minimum spacing distance Dmin (Dmin1, Dmin2, . . . Dmini) for each of the one or more entities E (E1, E2, . . . Ei) based on a personal space profile specifying user-specific distance preferences for how close the user prefers to be in spatial relation to each of the corresponding categories C (C1, C2, . . . Cj); and
providing feedback, by the first information handling system, to the user when any of the detected distances D (D1, D2, . . . Di) corresponding to the one or more entities E (E1, E2, . . . Ei) is within the than minimum spacing distance Dmin (Dmin1, Dmin2, . . . Dmini) corresponding to said one or more entities E (E1, E2, . . . Ei) entity.

2. The computer-implemented method of claim 1 , where receiving data regarding the environment comprises receiving data regarding the environment at one or more wearable devices worn by the user.

3. The computer-implemented method of claim 1 , where providing feedback to the user comprises providing feedback selected from a group consisting of audio, visual, and haptic based on a profile for the user and state of a first entity.

4. The computer-implemented method of claim 1 , where the minimum spacing distance Dmin for a first entity is adjusted based on a state of the first entity.

5. The computer-implemented method of claim 1 , wherein the minimum spacing distance Dmin determined for each of the one or more entities E (E1, E2, . . . Ei) is iteratively monitored and adjusted based on heuristics or a learned comfort level for the user being in proximity to the one or more entities E (E1, E2, . . . Ei).

6. The computer-implemented method of claim 1 , where applying the artificial intelligence (AI) machine learning analysis comprises deploying a reinforcement learning model on the guidance assistance device to generate an optimal notification to assist the user in navigating through the environment.

7. The computer-implemented method of claim 1 , where receiving data regarding the environment comprises using a camera embedded in a wearable device worn by the user to record video and audio data regarding the environment around the guidance assistance device.

8. The computer-implemented method of claim 7 , where analyzing the data regarding the environment around the guidance assistance device comprises employing a Region-Based Convolutional Neural Networks (R-CNN) model to identify from the video data, the one or more entities E (E1, E2, . . . Ei) in space and audio to associate with entities in the space while the user is navigating through the environment.

9. An information handling system comprising:
one or more processors;
a memory coupled to at least one of the processors;
a set of instructions stored in the memory and executed by at least one of the processors to provide navigation guidance around various object types in a vicinity of a guidance assistance device for a user, wherein the set of instructions are executable to perform actions of:
receiving, by the system, data regarding an environment around the guidance assistance device;
analyzing, by the system, the data regarding the environment around the guidance assistance device to identify one or more entities E (E1, E2, . . . Ei) and corresponding detected distances D (D1, D2, . . . Di) between the guidance assistance device and the one or more entities E (E1, E2, . . . Ei);
applying an artificial intelligence (AI) machine learning analysis to group the one or more entities E (E1, E2, . . . Ei) into corresponding categories C (C1, C2, . . . Cj) and to determine a minimum spacing distance Dmin (Dmin1, Dmin2, . . . Dmini) for each of the one or more entities E (E1, E2, . . . Ei) based on a personal space profile specifying user-specific distance preferences for how close the user prefers to be in spatial relation to each of the corresponding categories C (C1, C2, . . . Cj); and
providing feedback, by the system, to the user when any of the detected distances D (D1, D2, . . . Di) corresponding to the one or more entities E (E1, E2, . . . Ei) is within the than minimum spacing distance Dmin (Dmin1, Dmin2, . . . Dmini) corresponding to said one or more entities E (E1, E2, . . . Ei) entity.

10. The information handling system of claim 9 , wherein the set of instructions are executable to provide feedback to the user by providing feedback selected from a group consisting of audio, visual, and haptic based on a profile for the user and state of a first entity.

11. The information handling system of claim 9 , wherein the set of instructions are executable to adjust the minimum spacing distance Dmin for a first entity based on a state of the first entity.

12. The information handling system of claim 9 , wherein the set of instructions are executable to iteratively monitor and adjust the minimum spacing distance Dmin for each of the one or more entities E (E1, E2, . . . Ei) based on heuristics or a learned comfort level for the user being in proximity to the one or more entities E (E1, E2, . . . Ei).

13. The information handling system of claim 10 , wherein the set of instructions are executable to apply the artificial intelligence (AI) machine learning analysis by deploying a reinforcement learning model on the guidance assistance device to generate an optimal notification to assist the user in navigating through the environment.

14. The information handling system of claim 10 , wherein the set of instructions are executable to receive data regarding the environment by receiving video data from a camera embedded in a wearable device worn by the user to record video and audio data regarding the environment around the guidance assistance device.

15. The information handling system of claim 14 , wherein the set of instructions are executable to analyze the data regarding the environment around the guidance assistance device by employing a Region-Based Convolutional Neural Networks (R-CNN) model to identify, from the video data, the one or more entities E (E1, E2, . . . Ei) in space and audio to associate with entities in the space while the user is navigating through the environment.

16. A computer program product stored in a computer readable storage medium, comprising computer instructions that, when executed by an information handling system, causes the system to assist with navigation guidance around various object types in a vicinity of a guidance assistance device for a user by:
receiving, by the system comprising a processor and a memory, video data from a camera embedded in one or more wearable devices worn by the user to record video of the environment around the guidance assistance device;
analyzing, by the system, the video data regarding the environment around the guidance assistance device to identify one or more entities E (E1, E2, . . . Ei) and c

Assignees

• IBM

Inventors

• Kozhaya Joseph N
• Kwatra Shikhar
• Freed Andrew R
• Allen Corville O

Classifications

• G06N3/045

  Combinations of networks · CPC title

• G01C21/20 Primary

  Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence) · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title

• G06N3/08

  Learning methods · CPC title

• G06N20/00

  Machine learning · CPC title