Stereo image processing device for vehicle

Patent metadata

Field	Value
Publication number	US-9378553-B2
Application number	US-201514667265-A
Country	US
Kind code	B2
Filing date	Mar 24, 2015
Priority date	Mar 28, 2014
Publication date	Jun 28, 2016
Grant date	Jun 28, 2016

Abstract

In the lane line detection performed by a left-right similar object detection module, changes in brightness in the road width direction in a image plane are evaluated, a point group serving as a lane line candidate is extracted, and a lane line model is generated by calculating the parallax of left and right lane line candidate points and transforming the result into real space coordinates. A camera displacement diagnosis module determines a camera displacement by calculating a diagnostic value based on a difference between the parallaxes of the left and right lane lines in the same horizontal line between reference comparative images captured by a stereo camera unit. Where the camera displacement has occurred, a vehicle control device is instructed to stop the control function or make a transition to failsafe control, and a warning is issued instructing a user to take the vehicle to a maintenance site for inspection.

First claim

The invention claimed is:

1. A stereo image processing device for a vehicle that processes images captured by a stereo camera unit installed on the vehicle and three-dimensionally recognizes a traveling environment, the device comprising:
a left-right similar object detection module that detects a left side object present along a road and right side object which is present along the road and is similar to the left side object present as a pair on the left and right side of the vehicle from an image captured by the stereo camera unit, performs matching processing of the left side object and the right side object, and calculates a parallax of the left side object and a parallax of the right side object on a same horizontal line of the image; and
a camera displacement diagnosis module that calculates a diagnostic value based on a difference between the parallax of the left side object and the parallax of the right side object on the same horizontal line, compares the diagnostic value with a preset threshold value, and diagnoses a vertical mechanical displacement in the stereo camera unit.

2. The stereo image processing device for a vehicle according to claim 1 , wherein the left side object and the right side object are left and right lane lines on a road surface.

3. The stereo image processing device for a vehicle according to claim 1 , wherein a coordinate value based on a parallax of the left side object at any point and a parallax of the right side object at any corresponding point and a coordinate value based on a distance of the left side object at the any point and a distance of the right side object at the any corresponding point is used as the diagnostic value.

4. The stereo image processing device for a vehicle according to claim 1 , wherein a difference between a height of the left side object in a real space and a height of the right side object in the real space is used as the diagnostic value, the height of the left side object and the height of the right side object being determined based on the parallax at a same distance from the vehicle in the real space.

5. The stereo image processing device for a vehicle according to claim 2 , wherein a difference between a height of the left side object in a real space and a height of the right side object in the real space is used as the diagnostic value, the height of the left side object and the height of the right side object being determined based on the parallax at a same distance from the vehicle in the real space.

6. The stereo image processing device for a vehicle according to claim 1 , wherein an inclination of a straight line obtained by linearly approximating a relationship between the height and distance of each of the left side object and the right side object in a real space is used as the diagnostic value.

7. The stereo image processing device for a vehicle according to claim 2 , wherein an inclination of a straight line obtained by linearly approximating a relationship between the height and distance of each of the left side object and the right side object in a real space is used as the diagnostic value.

8. The stereo image processing device for a vehicle according to claim 2 , wherein a difference between a height of the left side object in a real space and a height of the right side object in the real space is used as the diagnostic value, the height of the left side object and the height of the right side object being determined based on the parallax at a same distance from the vehicle in the real space.

Assignees

• Fuji Heavy Ind Ltd

Inventors

• Tamura Yuichiroh
• Natsume Kensaku

Classifications

• H04N13/239 Primary

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• H04N13/204

  using stereoscopic image cameras (stereoscopic photography G03B35/00) · CPC title

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• H04N2013/0081

  Depth or disparity estimation from stereoscopic image signals · CPC title

• G06K9/00791

  Physics · mapped topic