Gaze recognition system and method

Patent metadata

Field	Value
Publication number	US-2016238701-A1
Application number	US-201514838346-A
Country	US
Kind code	A1
Filing date	Aug 27, 2015
Priority date	Feb 12, 2015
Publication date	Aug 18, 2016
Grant date	—

Abstract

A gaze recognition method includes: a signal sensing step of sensing sound wave signals output from one or more sound wave transmitters disposed on a head of a user; a signal analyzing step of analyzing the sensed sound wave signals; and a gaze recognizing step of sensing relative displacement of the sound wave transmitters through signal analysis results for the sound wave signals to recognize a gaze change of the user.

First claim

What is claimed is:

1 . A gaze recognition method comprising:
a signal sensing step of sensing sound wave signals output from one or more sound wave transmitters disposed on a head of a user; a signal analyzing step of analyzing the sensed sound wave signals; and a gaze recognizing step of sensing relative displacement of the sound wave transmitters through signal analysis results for the sound wave signals to recognize a gaze change of the user.

2 . The gaze recognition method according to claim 1 , wherein the sound wave transmitters generate sound wave signals having different patterns.

3 . The gaze recognition method according to claim 1 , wherein the sound wave signals are implemented by an ultrasonic wave or a high frequency wave that is out of an audio frequency range of a human.

4 . The gaze recognition method according to claim 1 , wherein in the signal analyzing step, an intensity change of the sound wave signals depending on relative distance changes of the sound wave transmitters is calculated.

5 . The gaze recognition method according to claim 1 , wherein in the signal analyzing step, a frequency deviation of the sound wave signals due to the Doppler effect depending on movement of the sound wave transmitters is calculated.

6 . The gaze recognition method according to claim 1 , wherein in the signal analyzing step, a time difference between different sound wave signals simultaneously generated by the respective sound wave transmitters depending on movement of the sound wave transmitters is calculated.

7 . The gaze recognition method according to claim 1 , wherein in the gaze recognizing step, a three-dimensional vector toward which an accessory to which the sound wave transmitters are attached is directed is derived.

8 . The gaze recognition method according to claim 1 , further comprising a warning outputting step of outputting a warning signal depending on the gaze change of the user.

9 . A gaze recognition system comprising:
one or more sound wave transmitters configured to be attachable to or detachable from an accessory worn on a head of a user and output different sound wave signals; and a gaze recognizer configured to receive the sound wave signals output from the one or more sound wave transmitters and sense relative displacement of the sound wave transmitters through an analysis of the received sound wave signals to recognize a gaze change of the user.

10 . The gaze recognition system according to claim 9 , wherein each sound wave transmitter includes:
a sound wave generator configured to generate sound wave signals having predefined patterns; and a sound wave output configured to output the sound wave signals to the outside.

11 . The gaze recognition system according to claim 10 , wherein the one or more sound wave transmitters further includes a wearing sensor configured to sense whether or not the user wears the accessory.

12 . The gaze recognition system according to claim 9 , wherein the gaze recognizer includes:
a sound wave sensor configured to sense the sound wave signals output from the one or more sound wave transmitters; a calculator configured to calculate relative positions of the sound wave transmitters; and a controller configured to recognize a gaze of the user based on the relative positions of the sound wave transmitters.

13 . The gaze recognition system according to claim 12 , wherein the calculator calculates an intensity change of sound wave signals output from corresponding sound wave transmitters depending on relative distance changes of the sound wave transmitters from the sound wave sensor.

14 . The gaze recognition system according to claim 12 , wherein the calculator calculates a frequency deviation of sound wave signals output from corresponding sound wave transmitters due to the Doppler effect depending on movement of the sound wave transmitters.

15 . The gaze recognition system according to claim 12 , wherein the calculator calculates a time difference between different sound wave signals simultaneously generated by the respective sound wave transmitters depending on movement of the sound wave transmitters.

16 . The gaze recognition system according to claim 12 , wherein the gaze recognizer further includes an input configured to generate an input signal depending on gaze movement of the user recognized by the controller.

17 . The gaze recognition system according to claim 12 , wherein the gaze recognizer further includes a warning unit configured to detect whether or not driving of the user is safe depending on gaze information of the user to output a warning.

18 . The gaze recognition system according to claim 12 , wherein the gaze recognizer further includes a vehicle controller configured to detect whether or not the user recognizes an obstacle based on a gaze recognition result of the user and control driving of a vehicle so as to avoid the obstacle when it is detected that the user does not recognize the obstacle.

19 . A gaze recognition method, comprising steps of:
outputting, by sound wave transmitters associated with a head of a driver of a vehicle, sound wave signals having different patterns; sensing, by sound wave sensors disposed at different locations of the vehicle, the sound wave signals output from the sound wave transmitters; determining, by a calculator, a gaze change of the driver by calculating movement of the sound wave transmitters with reference to the sound wave sensors based on the sensed sound wave signals; and performing, by a vehicle controller, a predetermined operation of the vehicle in accordance with the determined gaze change of the driver.

20 . The gaze recognition method according to claim 19 , wherein the predetermined operation of the vehicle is one selected from the group consisting of outputting a warning signal to the driver, and activating or deactivating an apparatus of the vehicle located on a path of a gaze of the driver based on the determined gaze change of the driver.

Assignees

• Hyundai Motor Co Ltd

Inventors

• Oh Kwang Myung
• Sah Sung Jin
• Park Sung Min
• Lee Hui Sung

Classifications

• B60W30/09 Primary

  Taking automatic action to avoid collision, e.g. braking and steering · CPC title

• B60W2540/215

  Selection or confirmation of options · CPC title

• B60W30/08

  Active safety systems} predicting or avoiding probable or impending collision {or attempting to minimise its consequences · CPC title

• B60W2420/54

  Audio sensitive means, e.g. ultrasound · CPC title

• B60W2050/0057

  Frequency analysis, spectral techniques or transforms · CPC title