Augmented reality based driver assistance

Patent metadata

Field	Value
Publication number	US-10469769-B1
Application number	US-201816048476-A
Country	US
Kind code	B1
Filing date	Jul 30, 2018
Priority date	Jul 30, 2018
Publication date	Nov 5, 2019
Grant date	Nov 5, 2019

Abstract

A head mounted display (HMD) device worn by a user in a vehicular computing environment (VCE) can be augmented with video by measuring, within the VCE, a sight angle between a user's directional focus and a vehicle's directional orientation and augmenting, in response to a determination that the measured sight angle exceeds a threshold limit, an interface of the HMD device with a video feed of continuous live content captured within a central viewing area.

First claim

What is claimed is:

1. A method for augmenting video to a head mounted display (HMD) device worn by a user in a vehicular computing environment (VCE), the method comprising:
measuring, within the VCE, a sight angle between a user's directional focus and a vehicle's directional orientation;
measuring, at a plurality of incremental time periods throughout vehicular operations, the user's directional focus;
augmenting, in response to a determination that the measured sight angle exceeds a threshold limit, an interface of the HMD device with a video feed of continuous live content captured within a central viewing area;
augmenting, in response to a determination that the measured sight angle is within the threshold limit, the interface of the HMD device with a video feed of continuous live content captured within a peripheral viewing area, wherein the peripheral viewing area extends the central viewing area;
pausing, in response to a determination that an updated measured sight angle is within the threshold limit, the augmenting; and
storing, during vehicular operations, any one of the video feed of continuous live content captured within the central viewing area and the video feed of continuous live content captured within the peripheral viewing area for subsequent analysis and recall.

2. The method of claim 1 , wherein the central viewing area is determined based on the vehicle's directional orientation.

3. The method of claim 1 , wherein the augmenting commences after a delay.

4. A system comprising:
a head mounted display (HMD) device worn by a user in a vehicular computing environment (VCE);
a computer readable storage medium storing a corpus of data;
a user interface configured to receive input and present output; and
a processor communicatively coupled to the computer readable storage medium and the user interface and having a memory comprising instructions, which, when executed by the processor, cause the processor to perform a method comprising:
measuring, within the VCE, a sight angle between a user's directional focus and a vehicle's directional orientation;
measuring, at a plurality of incremental time periods throughout vehicular operations, the user's directional focus;
augmenting, in response to a determination that the measured sight angle exceeds a threshold limit, an interface of the HMD device with a video feed of continuous live content captured within a central viewing area;
augmenting, in response to a determination that the measured sight angle is within the threshold limit, the interface of the HMD device with a video feed of continuous live content captured within a peripheral viewing area, wherein the peripheral viewing area extends the central viewing area;
pausing, in response to a determination that an updated measured sight angle is within the threshold limit, the augmenting; and
storing, during vehicular operations, any one of the video feed of continuous live content captured within the central viewing area and the video feed of continuous live content captured within the peripheral viewing area for subsequent analysis and recall.

5. The system of claim 4 , wherein the central viewing area is determined based on the vehicle's directional orientation.

6. A computer program product for augmenting video to a head mounted display (HMD) device worn by a user in a vehicular computing environment (VCE), the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
measuring, within the VCE, a sight angle between a user's directional focus and a vehicle's directional orientation;
measuring, at a plurality of incremental time periods throughout vehicular operations, the user's directional focus;
augmenting, in response to a determination that the measured sight angle exceeds a threshold limit, an interface of the HMD device with a video feed of continuous live content captured within a central viewing area;
augmenting, in response to a determination that the measured sight angle is within the threshold limit, the interface of the HMD device with a video feed of continuous live content captured within a peripheral viewing area, wherein the peripheral viewing area extends the central viewing area;
pausing, in response to a determination that an updated measured sight angle is within the threshold limit, the augmenting; and
storing, during vehicular operations, any one of the video feed of continuous live content captured within the central viewing area and the video feed of continuous live content captured within the peripheral viewing area for subsequent analysis and recall.

7. The computer program product of claim 6 ,
wherein the central viewing area is determined based on the vehicle's directional orientation.

Assignees

• IBM

Inventors

• Mukherjee Maharaj
• Kwatra Shikhar
• Pourmirzaie Farrokh
• Rakshit Sarbajit K

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• B60R2300/304

  using merged images, e.g. merging camera image with stored images · CPC title

• B60R2300/20

  characterised by the type of display used · CPC title