Image processing apparatus and image processing method

Patent metadata

Field	Value
Publication number	US-9426364-B2
Application number	US-201214125555-A
Country	US
Kind code	B2
Filing date	Feb 16, 2012
Priority date	Sep 5, 2011
Publication date	Aug 23, 2016
Grant date	Aug 23, 2016

Abstract

An image processing apparatus comprises: first and second image capturing units with wide angle lenses which capture at least partly overlapping images; a vehicle speed detecting unit that detects the speed of a local vehicle; and a distance measuring unit that calculates the distance from the local vehicle to an object on the basis of a plurality of images captured by the first and second image capturing units. The higher the speed detected by the vehicle speed detecting unit is, the smaller the distance measuring unit makes the size of the pixel areas of the images output from the first and second image capturing units.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a plurality of image capturing units with wide angle lenses for capturing at least partly overlapping images;
a vehicle speed detecting unit for detecting a speed of a local vehicle;
a distance measuring unit for calculating a distance from the local vehicle to an object imaged by the plurality of image capturing units on a basis of a plurality of images captured by the plurality of image capturing units;
a visual recognition image generating unit for generating a visual recognition image for recognition of conditions near the local vehicle from the plurality of images captured by the plurality of image capturing units; and
a mode determining unit for causing the distance measuring unit to calculate the distance to the object when the speed detected by the vehicle speed detecting unit is equal to or greater than a predetermined threshold speed, and causing the visual recognition image generating unit to generate the visual recognition image when the speed detected by the vehicle speed detecting unit is less than the predetermined threshold speed;
the distance measuring unit further comprising a pixel area determining unit for determining, for each of the plurality of image capturing units, sizes and positions of corresponding pixel areas in images output from each of the plurality of image capturing units, among all pixels usable for imaging in each of the plurality of image capturing units;
the pixel area determining unit making the size of the pixel areas smaller as the speed detected by the vehicle speed detecting unit becomes faster.

2. The image processing apparatus of claim 1 , wherein the visual recognition image generating unit further comprises:
a distortion correction unit for correcting distortion in each of the plurality of images captured by the plurality of image capturing units; and
an image combining unit for extracting at least some of the images from the plurality of images corrected by the distortion correction unit, and combining the extracted images to generate the visual recognition image.

3. An image processing method comprising:
an image capturing step for capturing a plurality of at least partly overlapping images through wide angle lenses;
a vehicle speed detecting step for detecting a speed of a local vehicle;
a distance measuring step for calculating a distance from the local vehicle to an object imaged in the image capturing step on a basis of the plurality of images captured in the image capturing step;
a visual recognition image generating step for generating a visual recognition image for recognition of conditions near the local vehicle from the plurality of images captured in the image capturing step; and
a mode determining step for causing the distance measuring step to calculate the distance to the object when the speed detected by the vehicle speed detecting step is equal to or greater than a predetermined threshold speed, and causing the visual recognition image generating step to generate the visual recognition image when the speed detected by the vehicle speed detecting step is less than the predetermined threshold speed;
the distance measuring step further comprising a pixel area determining step for determining sizes and positions of corresponding pixel areas in images output in the image capturing step for each of the plurality of images, among all pixels usable for imaging in the image capturing step;
the pixel area determining step making the size of the pixel areas smaller as the speed detected in the vehicle speed detecting step becomes faster.

4. The image processing method of claim 3 , wherein the visual recognition image generating step further comprises:
a distortion correction step for correcting distortion in each of the plurality of images captured in the image capturing step; and
an image combining step for extracting at least some of the images from the plurality of images corrected in the distortion correction step, and combining the extracted images to generate the visual recognition image.

5. An image processing apparatus comprising:
a plurality of image capturing units with wide angle lenses for capturing at least partly overlapping images;
a vehicle speed detecting unit for detecting a speed of a local vehicle;
a distance measuring unit including a pixel area determining unit for determining, for each of the plurality of image capturing units, sizes and positions of corresponding pixel areas in images output from each of the plurality of image capturing units, among all pixels usable for imaging in each of the plurality of image capturing units, a feature point detecting unit for detecting a feature point of the object in each of the images captured by the plurality of image capturing units and determining respective positions of the feature point, and a distance calculating unit for calculating a distance from the local vehicle to an object imaged by the plurality of image capturing units on a basis of a plurality of images captured by the plurality of image capturing units;
a visual recognition image generating unit for generating a visual recognition image for recognition of conditions near the local vehicle from the plurality of images captured by the plurality of image capturing units; and
a camera parameter setting unit for causing the plurality of image capturing units to output images with the pixel area size determined by the pixel area determining unit;
the pixel area determining unit increasing a frame rate at which the images are read from the plurality of image capturing units by making the size of the pixel areas smaller as the speed detected by the vehicle speed detecting unit becomes faster, determining the positions of the pixel areas so as to include the positions of the feature point determined by the feature point detecting unit, and increasing a frame rate at which the images are read from the plurality of image capturing units by making the size of the pixel areas smaller as the positions of the feature point determined by the feature point detecting unit lie further below a center of all the pixels usable for imaging in each of the plurality of image capturing units.

6. The image processing apparatus of claim 5 , wherein:
the distance measuring unit further comprises a feature point position storage unit for storing feature point position information indicating the positions of the feature point determined by the feature point detecting unit; and
when the feature point detecting unit cannot detect the feature point, the pixel area determining unit determines a direction in which the feature point moved out-of-frame by referring to the feature point position information and moves the positions of the pixel areas in the determined direction.

7. The image processing apparatus of claim 5 , wherein:
the distance measuring unit further comprises an incident angle determining unit for determining angles at which light from the object is incident on the wide angle lenses, responsive to the positions of the feature point determined by the feature point detecting unit; and
the distance calculating unit calculates the distance to the object on a basis of the angles of incidence determined by the incident angle determining unit.

8. The image processing apparatus of claim 7 , wherein:
the image capturing units further comprise imaging devices that receive light that has passed through the wide angle lenses;
the distance measuring unit further comprises a numeric value storage unit for storing numeric information indicating angles of incidence of light from the object that has passed through centers of the wide angle lenses for respective distances from centers of image planes of the imaging devi

Assignees

• Hashimoto Mitsuo
• Mitsubishi Electric Corp

Inventors

• Hashimoto Mitsuo

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06K9/00805

  Physics · mapped topic

• H04N5/23238 Primary

  Electricity · mapped topic

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G01C3/06 Primary

  Use of electric means to obtain final indication · CPC title