Stereo camera device

Patent metadata

Field	Value
Publication number	US-10501059-B2
Application number	US-201615765853-A
Country	US
Kind code	B2
Filing date	Nov 7, 2016
Priority date	Nov 25, 2015
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

The purpose of the present invention is to enable precise calculation of the distance to a moving object that is detected in a monocular area even in the case where the road height varies between an overlapping area and the monocular area. According to the present invention, provided are a parallax-information obtaining unit that obtains parallax information about an overlapping area of a plurality of images captured by a plurality of cameras installed in a vehicle; and an object-distance calculating unit that calculates the distance between an object detected in a non-overlapping area and the vehicle, the non-overlapping area being an area other than the overlapping area in the images, on the basis of parallax information obtained from the overlapping area in the past.

First claim

The invention claimed is:

1. A stereo camera device, comprising:
a plurality of cameras installed in a vehicle,
wherein the stereo camera device obtains disparity information of an overlapping area of a plurality of images captured by the plurality of cameras installed in the vehicle, and calculates a distance between the vehicle and an object detected in a non-overlapping area other than the overlapping area in each of the plurality of images on a basis of the disparity information obtained from the overlapping area in the past.

2. The stereo camera device according to claim 1 , wherein the stereo camera device calculates a road surface height on the basis of the disparity information, wherein:
the object is detected on a road surface in the non-overlapping area with a height different from a height of the road surface in the overlapping area; and
the stereo camera device calculates a distance to the object detected in the non-overlapping area.

3. The stereo camera device according to claim 2 , wherein the stereo camera device stores road surface height information of a sidewalk, wherein when an image area where a road surface height of the sidewalk is measured has moved to the non-overlapping area according to a movement of the vehicle, the stereo camera device calculates the distance between the object and the vehicle by correcting a position of the object in an image height direction using the road surface height information of the sidewalk stored in the stereo camera device.

4. The stereo camera device according to claim 1 , wherein:
the object detected in the non-overlapping area is a pedestrian who is moving and detected by an optical flow; and
the pedestrian detected by the optical flow is traced by a pattern matching method in and after a next frame.

5. The stereo camera device according to claim 1 , wherein the disparity information is stored for each of areas obtained by dividing the overlapping area at particular intervals in a vertical direction.

6. A travel control device,
wherein the travel control device detects a distance to a moving object using an overlapping area of a plurality of images, and controls warning or braking of an own vehicle on a basis of the detected distance,
wherein a timing of operating a brake of the own vehicle or a timing of warning is the same when the moving object runs out from a predetermined horizontal position in a non-overlapping area in an image and when the moving object runs out from a predetermined vertical position located at a horizontal distance from the own vehicle that is equal to a horizontal distance of the predetermined horizontal position from the own vehicle, wherein a height of the predetermined vertical position is vertically higher than a height of the predetermined horizontal position.

7. A front monitoring system comprising:
a laser radar; and
a monocular camera for monitoring an area in front of a vehicle,
wherein the front monitoring system obtains distance information from the laser radar to a measurement object, and calculates a distance between the vehicle and an object detected in a non-overlapping area out of a range where the laser radar can measure in an image from the monocular camera, on a basis of the distance information obtained by the laser radar in the past.

Assignees

• Hitachi Automotive Systems Ltd

Inventors

• Matsuo Shigeru
• Kitamura Tadaaki
• Nonaka Shinichi
• Nagasaki Takeshi

Classifications

• G01C3/06

  Use of electric means to obtain final indication · CPC title

• G08G1/16

  Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08) · CPC title

• G06T1/00

  General purpose image data processing · CPC title

• G01S17/931

  of land vehicles · CPC title

• G01S17/08

  for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48) · CPC title