Vehicle vision system

Patent metadata

Field	Value
Publication number	US-9280202-B2
Application number	US-201414272834-A
Country	US
Kind code	B2
Filing date	May 8, 2014
Priority date	May 10, 2013
Publication date	Mar 8, 2016
Grant date	Mar 8, 2016

Abstract

A vision system of a vehicle includes an interior monitoring system operable to determine a gaze direction of the driver of the vehicle. A plurality of cameras is disposed at a vehicle and the cameras have respective fields of view exterior of the vehicle. A heads up display system is operable to display virtual images for viewing by the driver of the vehicle, with the displayed virtual images being displayed in the driver's gaze direction, such as via heads up display glasses worn by the driver. Responsive to a determination of the driver gazing in a direction towards a non-transparent portion of the vehicle, the heads up display system displays an image derived from image data captured by at least one of the plurality of cameras to display a virtual image representative of the driver's view as it would be through the non-transparent portion of the vehicle.

First claim

The invention claimed is:

1. A vision system of a vehicle, said vision system comprising:
a monitoring system operable to determine a gaze direction of a driver of a vehicle equipped with said vision system, said monitoring system comprising an interior viewing camera having a field of view interior of the equipped vehicle and directed generally towards the head of the driver of the equipped vehicle, wherein, responsive to processing of image data captured by said interior viewing camera, said monitoring system determines the gaze direction of the driver of the equipped vehicle;
a plurality of exterior viewing cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle;
a heads up display system operable to display virtual images for viewing by the driver of the equipped vehicle; and
wherein, responsive at least in part to determination by said monitoring system that the driver's gaze direction is towards a non-transparent portion of the equipped vehicle, said heads up display system displays an image derived from image data captured by at least one of said plurality of exterior viewing cameras to display a virtual image representative of the driver's view in the determined driver's gaze direction as it would be through the non-transparent portion of the equipped vehicle.

2. The vision system of claim 1 , wherein the displayed virtual image is viewed by the driver as if the non-transparent portion of the equipped vehicle that the driver would be looking through is at least partially transparent.

3. The vision system of claim 1 , wherein said heads up display system is incorporated into heads up display eyeglasses that are worn by the driver of the equipped vehicle.

4. The vision system of claim 1 , wherein said heads up display system is operable to display information pertaining to at least one vehicle accessory for viewing by the driver of the equipped vehicle.

5. The vision system of claim 4 , wherein said heads up display system is operable to display accessory information responsive at least in part to the determined driver's gaze direction.

6. The vision system of claim 5 , wherein said heads up display system is operable to display at least one of the virtual image and accessory information responsive at least in part to a determined driving condition.

7. The vision system of claim 6 , wherein, responsive to determination of a parking maneuver of the equipped vehicle, said heads up display is operable to display the virtual image.

8. The vision system of claim 7 , wherein, responsive to determination of a forward driving condition, said heads up display is operable to display accessory information.

9. The vision system of claim 6 , wherein, during a forward driving condition, and responsive to determination that the driver's gaze direction is towards the engine compartment of the equipped vehicle, said heads up display is operable to display information pertaining to at least one of (i) engine operating RPM, (ii) oil pressure, (iii) oil level, (iv) coolant temperature and (v) tire pressure.

10. The vision system of claim 1 , further comprising a gesture control system operable to determine a gesture of the driver and wherein said vision system controls a virtual viewing angle of the displayed virtual image responsive to the determined gesture.

11. The vision system of claim 1 , further comprising a gesture control system operable to determine a gesture of the driver and wherein said vision system controls at least one accessory of the equipped vehicle responsive to the determined gesture.

12. The vision system of claim 11 , wherein said heads up display system displays at least one virtual user input and wherein said gesture control system is operable to determine movement of the driver's hand relative to the virtual user input, and wherein, responsive to the determined movement, said vision system is operable to control a vehicle accessory associated with the displayed virtual user input.

13. A vision system of a vehicle, said vision system comprising:
a monitoring system operable to determine a gaze direction of a driver of a vehicle equipped with said vision system, said monitoring system comprising an interior viewing camera having a field of view interior of the equipped vehicle and directed generally towards the head of the driver of the equipped vehicle;
a plurality of exterior viewing cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle;
a heads up display system operable to display virtual images for viewing by the driver of the equipped vehicle, wherein said heads up display system is incorporated into heads up display eyeglasses that are worn by the driver of the equipped vehicle when operating the equipped vehicle;
wherein, responsive at least in part to determination by said monitoring system that the driver's gaze direction is towards a non-transparent portion of the equipped vehicle, said heads up display system displays an image derived from image data captured by at least one of said plurality of exterior viewing cameras to display a virtual image representative of the driver's view in the determined driver's gaze direction as it would be through the non-transparent portion of the equipped vehicle; and
wherein the displayed virtual image is viewed by the driver as if the non-transparent portion of the equipped vehicle that the driver would be looking through is at least partially transparent.

14. The vision system of claim 13 , wherein said heads up display system is operable to display information pertaining to at least one vehicle accessory for viewing by the driver of the equipped vehicle, and wherein said heads up display system is operable to display accessory information responsive at least in part to the determined driver's gaze direction.

15. The vision system of claim 14 , wherein said heads up display system is operable to display at least one of the virtual image and accessory information responsive at least in part to a determined driving condition.

16. The vision system of claim 15 , wherein, responsive to determination of a parking maneuver of the equipped vehicle, said heads up display is operable to display the virtual image, and wherein, responsive to determination of a forward driving condition, said heads up display is operable to display accessory information.

17. The vision system of claim 13 , further comprising a gesture control system operable to determine a gesture of the driver and wherein said vision system at least one of (i) controls a virtual viewing angle of the displayed virtual image responsive to the determined gesture and (ii) controls at least one accessory of the equipped vehicle responsive to the determined gesture.

18. A vision system of a vehicle, said vision system comprising:
a monitoring system operable to determine a gaze direction of a driver of a vehicle equipped with said vision system, said monitoring system comprising an interior viewing camera having a field of view interior of the equipped vehicle and directed generally towards the head of the driver of the equipped vehicle;
a plurality of exterior viewing cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle;
a heads up display system operable to display virtual images for viewing by the driver of the equipped vehicle, wherein said heads up display system is incorporated into heads up display eyeglasses that are worn by the driver of the equipped vehicle;
wherein, responsi

Assignees

• Magna Electronics Inc

Inventors

• Gieseke Achim
• Biemer Michael

Classifications

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/005 Primary

  Input arrangements through a video camera · CPC title

• B60R2300/806

  for aiding parking · CPC title

• B60R2300/105

  using multiple cameras · CPC title