Systems and methods for braking a vehicle based on a detected object

Patent metadata

Field	Value
Publication number	US-9650025-B2
Application number	US-201514720187-A
Country	US
Kind code	B2
Filing date	May 22, 2015
Priority date	May 22, 2014
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

Systems and methods are provided for detecting an object and causing a vehicle to brake based on the detection. In one implementation, an object detecting and braking system for a vehicle includes at least one image capture device configured to acquire a plurality of images of an area including an object in front of the vehicle. The system includes at least one processing device programmed to perform a first image analysis to determine a first estimated time-to-collision of the vehicle with the object, and to perform a second image analysis to determine a second estimated time-to-collision of the vehicle with the object. The processing device is also programmed to calculate a difference between the first estimated time-to-collision and the second estimated time-to-collision, to determine that the difference does not exceed a predetermined threshold, and to cause the vehicle to brake based on the determination that the difference does not exceed the predetermined threshold.

First claim

What is claimed is:

1. An object detecting and braking system for a vehicle, comprising:
at least one image capture device configured to acquire a plurality of images of an area including an object in front of the vehicle;
a data interface; and
at least one processing device programmed to:
receive the plurality of images via the data interface;
perform a first image analysis based on at least a first image and a second image to determine a first estimated time-to-collision of the vehicle with the object;
perform a second image analysis based on at least a third image and a fourth image to determine a second estimated time-to-collision of the vehicle with the object, the second image analysis including:
determining a focus of expansion based on the third image and the fourth image, the focus of expansion being a converging point of vectors in a vector field determined from the third image and the fourth image; and
determining a rate of expansion associated with a point in the vector field relative to the focus of expansion by dividing a magnitude of a vector associated with the point by a distance from the point to the focus of expansion;

calculate a difference between the first estimated time-to-collision and the second estimated time-to-collision;
determine that the difference does not exceed a predetermined threshold; and
cause the vehicle to brake based on the determination that the difference does not exceed the predetermined threshold.

2. The object detecting and braking system of claim 1 , wherein the first image analysis includes:
determining a first size of the object appearing in the first image;
determining a second size of the object appearing in the second image;
determining a change in size of the object based on the first size and the second size; and
determining the first estimated time-to-collision based on the change in size of the object and a predetermined time interval between times of acquisition of the first image and the second image.

3. The object detecting and braking system of claim 1 ,
wherein each point in the vector field is represented by a vector indicating a magnitude and a direction of movement from a first point in the third image to a corresponding second point in the fourth image, and
wherein the second image analysis further includes:
determining the second estimated time-to-collision based on the rate of expansion and a time interval between times of acquisition of the third image and the fourth image.

4. The object detecting and braking system of claim 1 , wherein the second image analysis includes:
determining a relationship between magnitudes and distances for a plurality of points in the vector field; and
determining that the object represented by the plurality of points is a low time-to-collision upright object based on a determination that the relationship is a linear relationship.

5. The object detecting and braking system of claim 1 , wherein the second image analysis includes:
determining a relationship between magnitudes and distances for a plurality of points in the vector field; and
determining that at least a portion of the object is a road surface based on a determination that the relationship is a non-linear relationship.

6. The object detecting and braking system of claim 1 ,
wherein each point in the vector field is represented by a vector indicating a magnitude and a direction of movement from a first point in the third image to a corresponding second point in the fourth image, and
wherein the second image analysis further includes:
detecting a first focus of expansion that is a first converging point of a first plurality of vectors in the vector field;
detecting a second focus of expansion that is a second converging point of a second plurality of vectors in the vector field; and
determining that the third image and the fourth image include a moving object that moves in a direction that is not parallel to a travel direction of the vehicle.

7. The object detecting and braking system of claim 1 ,
wherein each point in the vector field is represented by a vector indicating a magnitude and a direction of movement from a first point in the third image to a corresponding second point in the fourth image, and
wherein the second image analysis further includes:
determining that the third image and the fourth image represent an environment that is static relative to a road surface on which the vehicle is traveling.

8. The object detecting and braking system of claim 1 , wherein the first image used for the first image analysis is different from the third image used for the second image analysis, and wherein the second image used for the first image analysis is different from the fourth image used for the second image analysis.

9. The object detecting and braking system of claim 1 , wherein the first image used for the first image analysis is the same as the third image used for the second image analysis, and wherein the second image used for the first image analysis is the same as the fourth image used for the second image analysis.

10. The object detecting and braking system of claim 1 , wherein the first image analysis and the second image analysis are independent of each other.

11. The object detecting and braking system of claim 1 , wherein the at least one image capture device includes:
a first image sensor configured to capture the first image and the second image to be used in the first image analysis; and
a second image sensor independent of the first image sensor and configured to capture the third image and the fourth image to be used in the second image analysis.

12. A vehicle, comprising:
a body;
at least one image capture device configured to acquire a plurality of images of an area including an object in front of the vehicle;
a data interface; and
at least one processing device programmed to:
receive the plurality of images via the data interface;
perform a first image analysis based on at least a first image and a second image to determine a first estimated time-to-collision of the vehicle with the object;
perform a second image analysis based on at least a third image and a fourth image to determine a second estimated time-to-collision of the vehicle with the object, the second image analysis including:
determining a focus of expansion based on the third image and the fourth image, the focus of expansion being a converging point of vectors in a vector field determined from the third image and the fourth image; and
determining a rate of expansion associated with a point in the vector field relative to the focus of expansion by dividing a magnitude of a vector associated with the point by a distance from the point to the focus of expansion;

calculate a difference between the first estimated time-to-collision and the second estimated time-to-collision;
determine that the difference does not exceed a predetermined threshold; and
cause the vehicle to brake based on the determination that the difference does not exceed the predetermined threshold.

13. The vehicle of claim 12 , wherein the first image analysis includes:
determining a first size of the object appearing in the first image;
determining a second size of the object appearing in the second image;
determining a change in size of the object based on the first size and the second size; and
determining the first estimated time-to-collision based on the change in size of the object and a predetermined time interval between times of acquisition of the first image and the second image.

14. The vehicle of claim 12 , wherein each point in the vector

Assignees

• Dagan Erez
• Mobileye Vision Technologies Ltd

Inventors

• Dagan Erez

Classifications

• B60T17/221 Primary

  Procedure or apparatus for checking or keeping in a correct functioning condition of brake systems (hydraulic pressure systems in general F15B19/00, F15B21/04; testing structures or apparatus G01M) · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• B60T7/22 Primary

  initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle {, or by means of contactless obstacle detectors mounted on the vehicle} · CPC title

• G07C5/0808

  Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005) · CPC title

• B60T8/172

  Determining control parameters used in the regulation, e.g. by calculations involving measured or detected parameters {(B60T8/17551 takes precedence)} · CPC title