Forward facing sensing system for vehicle

Patent metadata

Field	Value
Publication number	US-9140789-B2
Application number	US-201314107624-A
Country	US
Kind code	B2
Filing date	Dec 16, 2013
Priority date	Jan 25, 2007
Publication date	Sep 22, 2015
Grant date	Sep 22, 2015

Abstract

A vehicular forward facing sensing system includes a radar sensor device disposed within an interior cabin of a vehicle and having a sensing direction forward of the vehicle. An image sensor is disposed within the interior cabin of the vehicle and has a viewing direction forward of the vehicle. A control includes an image processor, which is operable to analyze images captured by the image sensor in order to, at least in part, detect an object present forward of the vehicle. The control, at least in part, determines that a potentially hazardous condition may exist in the path of forward travel of the vehicle. The radar sensor device and image sensor collaborate in a way that enhances the sensing capability of the sensing system for the potentially hazardous condition in the path of forward travel of the vehicle. The image processor processes captured image data utilizing object detection software.

First claim

The invention claimed is:

1. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:
a radar sensor device disposed within an interior cabin of a vehicle equipped with said forward facing sensing system, and wherein said radar sensor device has a sensing direction forward of the equipped vehicle;
wherein said radar sensor device comprises an array antenna and wherein said radar sensor device utilizes digital beam forming;
an image sensor disposed within the interior cabin of the equipped vehicle and wherein said image sensor has a viewing direction forward of the equipped vehicle;
wherein said image sensor comprises a pixelated image array sensor having a two dimensional array of photosensing elements;
wherein said image sensor is at least one of (a) proximate to a windshield of the equipped vehicle and (b) optically coupled at a windshield of the equipped vehicle;
wherein said radar sensor device and said image sensor are disposed behind the vehicle windshield in a windshield electronics module;
a control comprising an image processor;
wherein said image processor processes image data captured by said image sensor utilizing object detection software;
wherein processing by said image processor of image data captured by said image sensor utilizing object detection software comprises processing of pixel outputs within a sub-array of said image sensor;
wherein said image processor is operable to analyze image data captured by said image sensor in order to, at least in part, detect an object present forward of the equipped vehicle in its direction of forward travel;
wherein said control, responsive at least in part to processing by said image processor of captured image data and to an output of said radar sensor device, determines that a potentially hazardous condition may exist in the path of forward travel of the equipped vehicle, and wherein said potentially hazardous condition comprises another vehicle in the path of forward travel of the equipped vehicle;
wherein said radar sensor device and said image sensor collaborate in a way that enhances the sensing capability of said sensing system for determining the potentially hazardous condition in the path of forward travel of the equipped vehicle;
wherein, responsive to said control determining that a potentially hazardous condition exists in the path of forward travel of the equipped vehicle, said control generates an alert, and wherein said alert comprises at least one of (i) a visual indication and (ii) an audible indication;
wherein said image sensor comprises part of an automatic headlamp control system of the equipped vehicle and wherein said image sensor comprises part of a lane departure warning system of the equipped vehicle; and
wherein said control, responsive at least in part to processing by said image processor of captured image data and to an output of said radar sensor device, at least in part controls an adaptive cruise control system of the equipped vehicle.

2. The sensing system of claim 1 , wherein at least one of (a) said radar sensor device utilizes at least one of beam aiming and beam selection, (b) said radar sensor device utilizes digital beam steering, and (c) said radar sensor device comprises a phased array antenna.

3. The sensing system of claim 1 , wherein said radar sensor device and said image sensor share, at least in part, common circuitry.

4. The sensing system of claim 1 , wherein said alert comprises a visual indication comprising at least one of (i) an enhancement of an image displayed on a display screen disposed in the interior cabin of the equipped vehicle and (ii) an overlay on an image displayed on a display screen disposed in the interior cabin of the equipped vehicle.

5. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:
a radar sensor device disposed within an interior cabin of a vehicle equipped with said forward facing sensing system, and wherein said radar sensor device has a sensing direction forward of the equipped vehicle;
wherein said radar sensor device comprises an array antenna and wherein said radar sensor device utilizes digital beam forming;
an image sensor disposed within the interior cabin of the equipped vehicle and wherein said image sensor has a viewing direction forward of the equipped vehicle;
wherein said image sensor comprises a pixelated image array sensor having a two dimensional array of photosensing elements;
wherein said image sensor is at least one of (a) proximate to a windshield of the equipped vehicle and (b) optically coupled at a windshield of the equipped vehicle;
wherein said radar sensor device and said image sensor are disposed behind the vehicle windshield in a windshield electronics module;
a control comprising an image processor;
wherein said image processor processes image data captured by said image sensor utilizing object detection software;
wherein processing by said image processor of image data captured by said image sensor utilizing object detection software comprises processing of pixel outputs within a sub-array of said image sensor;
wherein said image processor is operable to analyze image data captured by said image sensor in order to, at least in part, detect an object present forward of the equipped vehicle in its direction of forward travel;
wherein said control, responsive at least in part to processing by said image processor of captured image data and to an output of said radar sensor device, determines that a potentially hazardous condition may exist in the path of forward travel of the equipped vehicle, and wherein said potentially hazardous condition comprises a person in the path of forward travel of the equipped vehicle;
wherein said radar sensor device and said image sensor collaborate in a way that enhances the sensing capability of said sensing system for determining the potentially hazardous condition in the path of forward travel of the equipped vehicle;
wherein, responsive to said control determining that a potentially hazardous condition exists in the path of forward travel of the equipped vehicle, said control generates an alert, and wherein said alert comprises at least one of (i) a visual indication and (ii) an audible indication;
wherein said image sensor comprises part of an automatic headlamp control system of the equipped vehicle and wherein said image sensor comprises part of a lane departure warning system of the equipped vehicle; and
wherein said control, responsive at least in part to processing by said image processor of captured image data and to an output of said radar sensor device, at least in part controls an adaptive cruise control system of the equipped vehicle.

6. The sensing system of claim 5 , wherein at least one of (a) said radar sensor device utilizes at least one of beam aiming and beam selection, (b) said radar sensor device utilizes digital beam steering, and (c) said radar sensor device comprises a phased array antenna.

7. The sensing system of claim 5 , wherein said radar sensor device and said image sensor share, at least in part, common circuitry.

8. The sensing system of claim 5 , wherein said alert comprises a visual indication comprising at least one of (i) an enhancement of an image displayed on a display screen disposed in the interior cabin of the equipped vehicle and (ii) an overlay on an image displayed on a display screen disposed in the interior cabin of the equipped vehicle.

9. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:
a radar sensor device disposed within an interior cabin of a v

Assignees

• Magna Electronics Inc

Inventors

• Lynam Niall R

Classifications

• G08G1/166

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title

• G01S2013/93276

  in the windshield area · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01S2013/9322

  using additional data, e.g. driver condition, road state or weather data · CPC title

• B60T7/22

  initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle {, or by means of contactless obstacle detectors mounted on the vehicle} · CPC title