Object detection device

Patent metadata

Field	Value
Publication number	US-10627228-B2
Application number	US-201615540304-A
Country	US
Kind code	B2
Filing date	Jan 29, 2016
Priority date	Feb 12, 2015
Publication date	Apr 21, 2020
Grant date	Apr 21, 2020

Abstract

The purpose of the present invention is to provide an object detection device conducive to carrying out control in an appropriate manner according to the surrounding environment, with consideration to the accuracy of locations of detected objects. The device is characterized by being provided with: a parallax information generation unit for generating parallax information from a plurality of parallax images acquired from a plurality of imaging units; an object detection unit for detecting objects contained in the parallax images; a location information generation unit for generating location information about the objects, on the basis of the parallax information; and a location accuracy information generation unit for generating location accuracy information pertaining to the accuracy of the location information, on the basis of the condition of generation of the parallax information.

First claim

The invention claimed is:

1. An object detection device comprising:
an object detector configured to
generate parallax information from a plurality of parallax images acquired from a plurality of cameras;
detect objects contained in the parallax images;
generate location information about the objects, on the basis of the parallax information; and
generate location accuracy information pertaining to the accuracy of the location information, on the basis of a characteristic of the parallax information,
generate the location information on the basis of an effective parallax, the effective parallax being a parallax pertaining to a part of the objects for which stereo matching has been successfully performed in an object region corresponding to the objects, and
generate the location accuracy information on the basis of a histogram obtained by projecting an amount of effective parallaxes contained in an enlarged region including the object region corresponding to the objects and an adjacent region adjacent to the object region on one axis along an area between the object region and the adjacent region.

2. The object detection device according to claim 1 , wherein
the location accuracy information is generated on the basis of a proportion between an area of the object region containing the objects and an area of an effective parallax region which is included in the object region and from which effective parallaxes are obtained.

3. The object detection device according to claim 1 , wherein
the location accuracy information is generated on the basis of characteristic point information of a corresponding region corresponding to the object region containing the objects in at least a single parallax image in the plurality of parallax images.

4. The object detection device according to claim 1 , wherein,
the effective parallaxes are in the object region containing the objects and correspond to the distance of the objects, and the location information and the location accuracy information are generated on the basis of the effective parallaxes.

5. The object detection device according to claim 1 , wherein
when the accuracy of the location information of the objects is low, and the direction of movement of the objects determined from a time-series location of the objects makes an approach to a course of the object detection device, the location information about the objects and the location accuracy information are generated on the basis of parallax information for a forward section in the direction of movement of the objects, out of effective parallaxes being parallaxes pertaining to a part of the objects to which stereo matching has been performed in an object region corresponding to the objects.

6. The object detection device according to claim 1 , wherein
the object detector uses the cameras to detect a pedestrian, and when the pedestrian is imaged as overlapping other object in an optical axis direction of the cameras, the pedestrian and the other object are separated from each other, and the location information and the location accuracy information of the pedestrian are generated on the basis of the parallax information on a portion, of the pedestrian, separated from the other object.

7. The object detection device according to claim 1 , wherein the object detector
is configured to generate the location accuracy information on the basis of a degree of overlap between an object region containing the objects and a halation region where halation occurs due to light.

8. The object detection device according to claim 1 , wherein
the object detector is further configured to generate the location accuracy information on the basis of a degree of overlap between an object region containing the objects and an accretion region where accretion is deposited to block imaging regions of the cameras.

9. The object detection device according to claim 1 , wherein
the object detection device is mounted on a vehicle, and is configured to change control level of the vehicle on the basis of the location information and the location accuracy information.

10. An object detection device comprising:
an object detector configured to:
generate parallax information from a plurality of parallax images acquired from a plurality of cameras;
detect objects contained in the parallax images;
generate location information about the objects, on the basis of the parallax information; and
generate location accuracy information pertaining to the accuracy of the location information, on the basis of a characteristic of the parallax information, wherein
the location information is generated on the basis of an effective parallax, the effective parallax being a parallax pertaining to a part of the objects to which stereo matching has been successfully performed in an object region corresponding to the objects, and
the location accuracy information is generated on the basis of a proportion between an area of the object region containing the objects and an area of an effective parallax region which is included in the object region and from which effective parallaxes are obtained.

11. An object detection device comprising:
an object detector configured to:
generate parallax information from a plurality of parallax images acquired from a plurality of cameras;
detect objects contained in the parallax images;
generate location information about the objects, on the basis of the parallax information; and
generate location accuracy information pertaining to the accuracy of the location information, on the basis of a characteristic of the parallax information, wherein
when the accuracy of the location information of the objects is low, and the direction of movement of the objects determined from a time-series location of the objects makes an approach to a course of the object detection device, the location information about the objects and the location accuracy information are generated on the basis of parallax information for a forward section in the direction of movement of the objects, out of effective parallaxes being parallaxes pertaining to a part of the objects to which stereo matching has been performed in an object region corresponding to the objects.

12. An object detection device comprising:
an object detector configured to:
generate parallax information from a plurality of parallax images acquired from a plurality of cameras;
detect objects contained in the parallax images;
generate location information about the objects, on the basis of the parallax information; and
generate location accuracy information pertaining to the accuracy of the location information, on the basis of a characteristic of the parallax information, wherein
the location accuracy information is generated on the basis of a degree of overlap between an object region containing the objects and a halation region where halation occurs due to light.

13. An object detection device comprising:
an object detector configured to:
generate parallax information from a plurality of parallax images acquired from a plurality of cameras;
detect objects contained in the parallax images;
generate location information about the objects, on the basis of the parallax information; and
generate location accuracy information pertaining to the accuracy of the location information, on the basis of a characteristic of the parallax information, wherein
the location accuracy information is generated on the basis of a degree of overlap between an object region containing the objects and an accretion region where accretion is deposited to block imaging regions of the imaging units.

Assignees

• Hitachi Automotive Systems Ltd

Inventors

• Takemura Masayuki
• Osato Takuma
• Shima Takeshi
• Otsuka Yuji

Classifications

• G01C11/06

  by comparison of two or more pictures of the same area · CPC title

• G01C3/085 Primary

  with electronic parallax measurement · CPC title

• G06T7/00

  Image analysis · CPC title

• G08G1/16

  Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08) · CPC title

• G01C11/30

  by triangulation · CPC title