Method for assisting a person in acting in a dynamic environment and corresponding system

Patent metadata

Field	Value
Publication number	US-10475348-B2
Application number	US-201815997930-A
Country	US
Kind code	B2
Filing date	Jun 5, 2018
Priority date	Jun 9, 2017
Publication date	Nov 12, 2019
Grant date	Nov 12, 2019

Abstract

The invention regards a method and a system for assisting a person in acting in a dynamic environment. At first, information on states at least two entities in a common environment is obtained. A future behaviour of each of the entities is then predicted based on the obtained information and a time to event for at least one predetermined event involving the at least two entities and a position of occurrence of the event relative to the person is estimated. Then, a signal indicative of the relative direction of the predicted event with respect to the person and indicative of the time to event for driving an actuator is generated, the signal causing a stimulation being perceivable by the person by its perceptual capabilities, wherein the time to event is encoded such that the signal's saliency is the higher the smaller the time to event is.

First claim

The invention claimed is:

1. A method for assisting a person in assessing a dynamic environment, comprising steps of:
obtaining information on states of at least two entities in a common environment;
predicting a future behavior of each of the entities based on the obtained information and at least one event involving the at least two entities;
estimating a time to event for the at least one predicted event involving the at least two entities and a position of occurrence of the at least one predicted event relative to the person or to a predetermined entity associated with the person; and
generating a signal for driving an actuator indicative of a relative direction of the predicted event with respect to the person and indicative of the time to event, the signal causing a stimulation being perceivable by the person by its perceptual capabilities,
wherein the stimulation is a stimulation signal causing the stimulation of the person at a dedicated location of the person's body to encode the relative direction, and
one or more parameters of the stimulation signal encode the time to event such that the signal's saliency is higher the smaller the time to event is.

2. The method according to claim 1 , wherein
the time to event estimation or the signal is adapted to a context for which an estimation of the time to event is performed.

3. The method according to claim 1 , wherein
the stimulation is a tactile stimulation signal.

4. The method according to claim 1 , wherein
the stimulation comprises an auditory stimulation signal causing sound to be generated at a location representative for the relative direction, wherein one or more parameters of the sound encode the time to event.

5. The method according to claim 1 , wherein
the stimulation comprises a visual stimulation signal causing a visual stimulus to be generated at a location representative for the relative direction, wherein one or more parameters of the visual stimulation signal encode the time to event.

6. The method according to claim 1 , wherein
the stimulation signal comprises an electromagnetic stimulation signal interacting with the person's nervous system or body parts, the electromagnetic stimulation signal being applied to the person such that it stimulates at a location of the body representative for the relative direction, wherein one or more parameters of the electromagnetic stimulation signal encode the time to event.

7. The method according to claim 1 , wherein
the stimulation signal comprises a chemical stimulation signal which is applied to the person such that it stimulates at a location of the body representative for the relative direction, wherein one or more parameters of the chemical stimulation signal encode the time to event.

8. The method according to claim 1 , wherein
the stimulation signal comprises a heat stimulation signal which is applied to the person at a dedicated location of the person's body to encode the relative direction, wherein a level of heat encodes the time to event.

9. The method according to claim 8 , wherein
the stimulation signal's saliency is compensated for different sensitivity of different locations of a body where it is applied and for different environmental conditions.

10. The method according to claim 1 , wherein
the at least one predicted event is a collision between at least two of the entities.

11. A system for assisting a person in assessing a dynamic environment, the system comprising:
a state information obtaining unit for obtaining information on states of at least two entities in a common environment;
processor for predicting a future behavior of each of the entities based on the obtained information, for predicting at least one event involving the at least two entities, and for estimating a time to event for the at least one predicted event and a position of occurrence of the at least one predicted event relative to the person; and
signal generator for generating a signal indicative of the relative direction of the event with respect to the person and indicative of the time to event, the signal causing an actuator to stimulate the person such that the stimulation is perceivable by the person using its perceptual capabilities,
wherein the signal is a stimulation signal causing the stimulation of the person at a dedicated location of the person's body to encode the relative direction, and
one or more parameters of the stimulation signal encode the time to event,
wherein the time to event being encoded such that the signal's saliency is higher the smaller the time to event is.

12. The system according to claim 11 , wherein
the system comprises a plurality of actuator elements of at least one of the following types vibrotactile actuator, pressure-applying actuator, loudspeaker, light emitter, electrode, induction coil, chemical emitter/agent, and heating element.

13. The system according to claim 12 , wherein
the plurality of actuator elements is arranged as an array.

14. The method according to claim 1 , further comprising:
selecting a basis for generating the signal from at least one of event, time to event, and direction.

15. The method according to claim 14 , wherein
the selecting is based on at least one of an availability of predictions in a given direction, context dependent criteria, a proximity of event, relevance of an entity, certainty of prediction, impact of false signals, and result of a comparison of a time to event with a threshold.

16. The method according to claim 1 , further comprising:
adapting a stimulus frequency range and a stimulus amplitude range to a preference and a sensitivity of the person.

Assignees

• Honda Res Inst Europe Gmbh

Inventors

• Krüger Matti

Classifications

• G08G9/02 Primary

  Anti-collision systems · CPC title

• G08G1/166

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title

• G08G1/165

  for passive traffic, e.g. including static obstacles, trees · CPC title

• G08G1/161 Primary

  Decentralised systems, e.g. inter-vehicle communication · CPC title