Vehicle vision system

Patent metadata

Field	Value
Publication number	US-9701258-B2
Application number	US-201414324696-A
Country	US
Kind code	B2
Filing date	Jul 7, 2014
Priority date	Jul 9, 2013
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

A vision system of a vehicle includes a camera in the vehicle with a field of view that encompasses at least a hand of a driver of the vehicle. A control includes an image processor operable to process image data captured by the camera. The control, responsive to image data processing, is operable to determine a hand of the driver of the vehicle and, responsive to determination of movement of the driver's hand, is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle. The control learns habitual movements of the driver's hand and, responsive to (i) determination that a detected gesture is not indicative of a learned habitual movement and (ii) determination that the detected gesture is indicative of a gesture for controlling an accessory of the equipped vehicle, the control generates an output for controlling the accessory.

First claim

The invention claimed is:

1. A vision system of a vehicle, said vision system comprising:
a camera disposed in an interior cabin of a vehicle equipped with said vision system, said camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;
a control comprising an image processor operable to process image data captured by said camera;
wherein said control, responsive to image processing of captured image data by said image processor, is operable to determine a movement of a hand of the driver of the equipped vehicle;
wherein, responsive to determination of movement of the driver's hand, said control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle;
wherein said control learns habitual movements of the driver's hand and is operable to distinguish intended gestures from learned habitual movements; and
wherein, responsive to (i) determination that a detected gesture is not indicative of a learned habitual movement and (ii) determination that the detected gesture is indicative of an intended gesture for controlling an accessory of the equipped vehicle, said control generates an output for controlling the accessory.

2. The vision system of claim 1 , wherein said control is operable to recognize the learned habitual movements of the driver to reduce false determinations of gestures.

3. The vision system of claim 1 , wherein said control learns habitual movements of multiple drivers and wherein said control, responsive to identification of the particular driver operating the equipped vehicle, is operable to determine whether a detected gesture of the particular driver is indicative of a learned habitual movement of that particular driver.

4. The vision system of claim 3 , wherein identification of the particular driver is made via one of (i) a user input and (ii) image processing of captured image data by said image processor.

5. The vision system of claim 1 , wherein the accessory comprises a plurality of cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle.

6. The vision system of claim 5 , wherein said vision system controls at least one of (a) a viewing angle of individual cameras and (b) a viewing angle of a virtual camera.

7. The vision system of claim 1 , comprising a display screen disposed in the interior cabin of the equipped vehicle and viewable by the driver of the equipped vehicle.

8. The vision system of claim 7 , wherein said display screen is operable to display at least one virtual user input and wherein said control is operable to determine actuation of the virtual user input responsive to movement of the driver's hands relative to a virtual location and type of user input of the displayed virtual user input.

9. The vision system of claim 1 , wherein said control learns habitual movements of the driver's hand responsive to image processing of multiple frames of captured image data by said image processor.

10. The vision system of claim 1 , wherein said control, after learning habitual movements of the driver's hand, is operable to discern an intentional gesture by the driver to control an accessory from a habitual movement of the driver's hand.

11. The vision system of claim 1 , wherein the learned habitual movement comprises at least one of (i) a repeating scratching movement, (ii) a repeating reach towards a region in the vehicle, (iii) a repeating movement corresponding to music playing in the vehicle.

12. A vision system of a vehicle, said vision system comprising:
a camera disposed in an interior cabin of a vehicle equipped with said vision system, said camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;
a control comprising an image processor operable to process image data captured by said camera;
wherein said control, responsive to image processing of captured image data by said image processor, is operable to determine a movement of a hand of the driver of the equipped vehicle;
wherein, responsive to determination of movement of the driver's hand, said control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle;
wherein said control learns habitual movements of the driver's hand for multiple drivers and stores habitual movement data for the multiple drivers, and wherein said control is operable to distinguish intended gestures of a driver from learned habitual movements of that driver;
wherein said control learns habitual movements of the driver's hand responsive to image processing of multiple frames of captured image data by said image processor; and
wherein, responsive to (i) identification of the particular driver operating the equipped vehicle, (ii) determination that a detected gesture is not indicative of a learned habitual movement of that particular driver and (iii) determination that the detected gesture is indicative of an intended gesture for controlling an accessory of the equipped vehicle, said control generates an output for controlling the accessory.

13. The vision system of claim 12 , wherein identification of the particular driver is made via one of (i) a user input and (ii) image processing of captured image data by said image processor.

14. The vision system of claim 12 , wherein the accessory comprises a plurality of cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle, and wherein said vision system controls at least one of (a) a viewing angle of individual cameras and (b) a viewing angle of a virtual camera.

15. The vision system of claim 12 , comprising a display screen disposed in the interior cabin of the equipped vehicle and viewable by the driver of the equipped vehicle, wherein said display screen is operable to display at least one virtual user input and wherein said control is operable to determine actuation of the virtual user input responsive to movement of the driver's hands relative to a virtual location and type of user input of the displayed virtual user input.

16. The vision system of claim 12 , wherein the learned habitual movement comprises at least one of (i) a repeating scratching movement, (ii) a repeating reach towards a region in the vehicle, (iii) a repeating movement corresponding to music playing in the vehicle.

17. A vision system of a vehicle, said vision system comprising:
a camera disposed in an interior cabin of a vehicle equipped with said vision system, said camera having a field of view that encompasses at least a hand of a driver of the equipped vehicle;
a control comprising an image processor operable to process image data captured by said camera;
wherein said control, responsive to image processing of captured image data by said image processor, is operable to determine a movement of a hand of the driver of the equipped vehicle;
wherein, responsive to determination of movement of the driver's hand, said control is operable to determine if the movement is indicative of a gesture for controlling an accessory of the equipped vehicle;
wherein said control learns habitual movements of the driver's hand and is operable to distinguish intended gestures from learned habitual movements;
wherein said control learns habitual movements of the driver's hand responsive to image processing of multiple frames of captured image data by said image processor;
wherein said control, after learning habitual movements of the driver's hand, is operable to discern an intended

Assignees

• Magna Electronics Inc

Inventors

• Tiryaki Riza

Classifications

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• B60R11/04 Primary

  Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle · CPC title

• H04N5/23238

  Electricity · mapped topic

• B60R2300/602

  with an adjustable viewpoint · CPC title