Alert generation correlating between head mounted imaging data and external device

Patent metadata

Field	Value
Publication number	US-9818283-B2
Application number	US-201514589914-A
Country	US
Kind code	B2
Filing date	Jan 5, 2015
Priority date	Jan 6, 2014
Publication date	Nov 14, 2017
Grant date	Nov 14, 2017

Abstract

A method of alerting a vehicle's driver. The method comprises receiving an azimuth value indicating a gazing direction of a head of the driver from a primary device placed on the driver, receiving a vehicle bearing value indicating a vehicle moving direction of the vehicle driven by the driver, calculating an angular difference between the azimuth value and the vehicle bearing value, generating an alert when the angular difference deviates from an angular threshold, and automatically presenting the alert to the driver in response to the angular difference.

First claim

The invention claimed is:

1. A method of alerting a vehicle's driver, comprising:
with a processor:
measuring head movements of the driver by a wearable mount placed on the driver;
calculating an azimuth value indicating a horizontal orientation facing direction of a head of said driver;
receiving a vehicle bearing value indicating a current vehicle moving direction of a vehicle driven by the driver;
calculating an angular difference between the azimuth value and the vehicle bearing value;
receiving a first set of image data, the first set of image data captured by a first image capture module coupled to the wearable mount and directing outwardly from the driver to capture a driver's perspective;
receiving a second set of image data, the second set of image data captured by a second image capture module mounted on the vehicle and oriented toward the current vehicle moving direction to capture a vehicle's perspective;
processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between the first and second sets of image data;
generating an alert according to said comparison result and when the angular difference deviates from an angular threshold, said angular threshold selected from a plurality of predefined angular thresholds according to a traffic condition; and
automatically presenting the alert via an alert module to the driver.

2. The method of claim 1 ,
wherein said generating further comprises generating an alert when the angular difference deviates from the angular threshold and the comparison result deviates from an image similarity threshold; and
automatically presenting the alert to the driver.

3. The method of claim 1 , wherein the angular threshold is dynamically modified based on the first and second sets of image data received.

4. The method of claim 1 , wherein the vehicle bearing value is generated by a geographical positioning system (GPS); and
wherein the vehicle bearing value is transmitted by one or more of a circuit coupled to the vehicle and a mobile device to the wearable mount placed on the driver.

5. The method of claim 1 , further comprising:
automatically presenting the alert to the driver in response to the angular difference while the angular difference is still present.

6. The method of claim 1 , wherein said automatically presenting the alert further comprises providing a suggestion to said driver to navigate to a rest location, said rest location including at least one of a restaurant, a coffee shop, a rest stop, and a parking lot.

7. A system of alerting a driver of a vehicle, comprising:
a wearable mount comprising a processor, said wearable mount configured to be placed on a head of said driver measuring head movements of said driver and calculating an azimuth value indicating a horizontal orientation facing direction of the head of said driver;
a first image sensor coupled to said wearable mount, the first image sensor directing outwardly from said driver to capture a driver's perspective;
a second image sensor coupled to the vehicle and oriented toward a vehicle moving direction to capture a vehicle's perspective;
wherein said processor executes code instructions comprising:
code instructions for receiving said azimuth value from said wearable mount placed on the driver;
code instructions for receiving a vehicle bearing value indicating a current vehicle moving direction of the vehicle driven by the driver;
code instructions for calculating an angular difference between the azimuth value and the vehicle bearing value;
code instructions for receiving a first set of image data captured by said first image sensor;
code instructions for receiving a second set of image data captured by said second image sensor;
code instructions for processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between said first and second sets of image data;
code instructions for generating an alert according to said comparison result and when the angular difference deviates from an angular threshold, said angular threshold selected from a plurality of predefined angular thresholds according to a traffic condition; and
code instructions for automatically presenting the alert via an alert module to the driver.

8. The system of claim 7 , further comprising:
code instructions for generating an alert when the angular difference deviates from the angular threshold and the comparison result deviates from an image similarity threshold; and
code instructions for presenting the alert to the driver.

9. The system of claim 7 , wherein said code instructions further comprise:
code instructions for receiving a plurality of wearable mount orientation values over a period of time;
code instructions for determining an angular velocity of the head of said driver by utilizing the plurality of wearable mount orientation values;
code instructions for generating an alert when the angular velocity deviates from an angular velocity threshold and the comparison result deviates from the angular threshold; and
code instructions for presenting the alert to the driver.

10. The system of claim 9 , wherein said angular velocity threshold and said angular threshold are selected according to a traffic heaviness condition.

11. The system of claim 7 , further comprising:
a mobile phone;
wherein said code instructions further comprise code instructions for presenting the alert to the mobile phone; and
the mobile phone sounds a notice as a result of the alert.

12. The system of claim 7 , wherein:
said wearable mount is a pair of glasses with an electronic display, and at least one of an accelerometer and a gyro; and
wherein said code instructions further comprise code instructions for presenting the alert on the electronic display.

13. The system of claim 7 , wherein:
said wearable mount is a pair of glasses with an electronic display and a GPS; and
wherein said code instructions further comprise code instructions for receiving the vehicle bearing value from the GPS.

14. The system of claim 7 , wherein:
the processor is directly coupled to a vehicle's computer system; and
said code instructions further comprising code instructions for transmitting the alert via wireless communication to said wearable mount.

15. A method of alerting a driver of a vehicle comprising:
with a processor:
receiving three-dimensional orientation information from a module on a wearable mount placed on the driver, the information indicating a horizontal orientation facing direction of a head of the driver;
determining based on the orientation information when the horizontal orientation facing direction is different from a current vehicle moving direction;
receiving a first set of image data, the first set of image data captured by a first image capture module coupled to the wearable mount and directing outwardly from said driver to capture a driver's perspective;
receiving a second set of image data, the second set of image data captured by a second image capture module oriented toward the current vehicle moving direction to capture a vehicle's perspective;
processing the first and second sets of image data to determine a comparison result, the comparison result determined according to image similarity between said first and second sets of image data;
generating an alert according to said comparison result and when the horizontal orientation facing direction is determined to be different from the current vehicle movin

Assignees

• Harman Int Ind
• Ionroad Tech Ltd

Inventors

• Akiva Ohad
• Atsmon Dan
• Dayan Ram

Classifications

• B60C9/00

  Reinforcements or ply arrangement of pneumatic tyres (inserts having reinforcing means B60C5/08; bead structure, e.g. turnup or overlap construction, B60C15/00) · CPC title

• B60W40/08

  related to drivers or passengers · CPC title

• G08B21/06 Primary

  indicating a condition of sleep, e.g. anti-dozing alarms · CPC title

• B60W2050/143

  Alarm means · CPC title

• B60W2540/22

  Psychological state; Stress level or workload · CPC title