Vehicular forward viewing image capture system

Patent metadata

Field	Value
Publication number	US-11148583-B2
Application number	US-202016948656-A
Country	US
Kind code	B2
Filing date	Sep 28, 2020
Priority date	Aug 11, 2006
Publication date	Oct 19, 2021
Grant date	Oct 19, 2021

Abstract

A vehicular forward viewing image capture system includes an accessory module configured for attachment at an in-cabin side of a windshield of a vehicle, whereby the imaging sensor views through the windshield forward of the equipped vehicle. With the accessory module attached at the in-cabin side of the windshield, and while the vehicle is traveling along a road, a control processes captured image data to determine (i) presence of an object of interest viewed by the imaging sensor and (ii) location and/or movement of the object of interest viewed by the imaging sensor. The control, responsive to the processing of captured image data and responsive to vehicle data received via a vehicle communication bus, at least in part provides at least one selected from the group consisting of (a) traffic sign recognition, (b) traffic light status detection, (c) adaptive cruise control and (d) pedestrian detection.

First claim

The invention claimed is:

1. A vehicular forward viewing image capture system, said vehicular forward viewing image capture system comprising:
an accessory module configured for attachment at an in-cabin side of a windshield of a vehicle equipped with said vehicular forward viewing image capture system;
wherein said accessory module comprises a camera, said camera comprising a lens and an imaging sensor, said imaging sensor comprising a two-dimensional array of photosensor elements;
wherein an optical axis of said lens is perpendicular to an image plane of said imaging sensor;
wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, said imaging sensor has a field of view through the windshield forward of the equipped vehicle;
a control, said control comprising a digital processor for processing image data captured by said imaging sensor;
wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, and while the equipped vehicle is traveling along a road, said control processes captured image data to determine (i) presence of an object of interest in the forward field of view of said imaging sensor and (ii) location of the object of interest in the forward field of view of said imaging sensor;
wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, and responsive to the processing of captured image data, said control determines presence of a taillight of another vehicle ahead of the equipped vehicle, and wherein said control is operable to determine presence of a taillight that is 200 meters ahead of the equipped vehicle;
wherein said control receives vehicle data via a vehicle communication bus; and
wherein the received vehicle data comprises vehicle speed data; and
wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, and responsive to the processing of captured image data and responsive to the received vehicle data, said control at least in part provides at least one selected from the group consisting of (a) traffic sign recognition, (b) traffic light status detection, (c) adaptive cruise control and (d) pedestrian detection.

2. The vehicular forward viewing image capture system of claim 1 , wherein the received vehicle speed data at least comprises a speed signal indicative of speed of the equipped vehicle.

3. The vehicular forward viewing image capture system of claim 2 , wherein an output of said control when the speed signal is indicative of the speed of the equipped vehicle being above a threshold speed level is different than the output of said control when the speed signal is indicative of the speed of the equipped vehicle being below a threshold speed level.

4. The vehicular forward viewing image capture system of claim 1 , wherein said vehicle communication bus comprises a CAN vehicle communication bus.

5. The vehicular forward viewing image capture system of claim 1 , wherein captured image data is processed at said control to determine a characteristic of the object of interest present in the forward field of view of said imaging sensor.

6. The vehicular forward viewing image capture system of claim 1 , wherein multiple frames of captured image data are processed at said control in determining the location of the object of interest present in the forward field of view of said imaging sensor.

7. The vehicular forward viewing image capture system of claim 1 , wherein multiple frames of captured image data are processed at said control to determine movement of the object of interest present in the forward field of view of said imaging sensor.

8. The vehicular forward viewing image capture system of claim 1 , wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, captured image data is processed at said control to determine a general illumination level at the equipped vehicle in the forward field of view of said imaging sensor.

9. The vehicular forward viewing image capture system of claim 1 , wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, captured image data is processed at said control to determine a road condition of the road ahead of the equipped vehicle.

10. The vehicular forward viewing image capture system of claim 1 , wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, captured image data is processed at said control to determine an incline of the road ahead of the equipped vehicle.

11. The vehicular forward viewing image capture system of claim 1 , wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, and responsive to processing of captured image data, said control determines presence of other road users in a region of influence of a vehicle headlamp of the equipped vehicle, and wherein said control is operable to inhibit adjustment of a beam pattern of the vehicle headlamp of the equipped vehicle if other road users are detected within the region of influence of the vehicle headlamp of the equipped vehicle.

12. The vehicular forward viewing image capture system of claim 1 , wherein said vehicular forward viewing image capture system automatically compensates for misalignment of said imaging sensor.

13. The vehicular forward viewing image capture system of claim 12 , wherein said vehicular forward viewing image capture system determines misalignment of said imaging sensor responsive at least in part to a focus of expansion ahead of the vehicle.

14. The vehicular forward viewing image capture system of claim 13 , wherein said vehicular forward viewing image capture system determines misalignment of said imaging sensor responsive to determination of location and movement of another vehicle relative to the focus of expansion as the equipped vehicle travels along a straight section of the road.

15. The vehicular forward viewing image capture system of claim 13 , wherein said vehicular forward viewing image capture system determines misalignment of said imaging sensor responsive to tracking movement of light sources through multiple frames of captured image data when the equipped vehicle travels along a straight section of the road.

16. The vehicular forward viewing image capture system of claim 1 , wherein the received vehicle data comprises vehicle trajectory data.

17. The vehicular forward viewing image capture system of claim 1 , wherein the received vehicle data comprises vehicle GPS data.

18. The vehicular forward viewing image capture system of claim 1 , wherein the received vehicle data comprises vehicle pitch data.

19. The vehicular forward viewing image capture system of claim 1 , wherein the received vehicle data comprises vehicle yaw data.

20. The vehicular forward viewing image capture system of claim 1 , wherein, with said accessory module attached at the in-cabin side of the windshield of the equipped vehicle, said imaging sensor views through a portion of the windshield that is swept by a windshield wiper of the equipped vehicle.

21. The vehicular forward viewing image capture system of claim 1 , wherein said accessory module comprises said control and an electrical connector for electrically connecting to a vehicle wiring system when said accessory module is attached at the in-cabin side of the windshield of the equipped vehicle.

Assignees

• Magna Electronics Inc

Inventors

• Schofield Kenneth

Classifications

• H04N25/76

  Addressed sensors, e.g. MOS or CMOS sensors · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06V20/584

  of vehicle lights or traffic lights · CPC title

• B60K31/00

  Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator · CPC title