Systems and methods for identifying relevant traffic lights

Patent metadata

Field	Value
Publication number	US-9446765-B2
Application number	US-201514610537-A
Country	US
Kind code	B2
Filing date	Jan 30, 2015
Priority date	Jan 30, 2014
Publication date	Sep 20, 2016
Grant date	Sep 20, 2016

Abstract

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a system includes at least one image capture device configured to acquire at least one image of an area forward of the vehicle. The area includes a plurality of traffic lamp fixtures each including at least one traffic light. The system further includes at least one processing device configured to use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures. The at least one processing device may determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle, and cause a system response based on the determined status.

First claim

What is claimed is:

1. A traffic light detection system or a vehicle; the system comprising:
at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;
a data interface; and
at least one processing device configured to:
receive the at least one acquired image via the data interface;
use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;
determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and
cause a system response based on the determined status.

2. The traffic light detection system of claim 1 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

3. The traffic light detection system of claim 1 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

4. The traffic light detection system of claim 1 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

5. The traffic light detection system of claim 1 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

6. The traffic light detection system of claim 1 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

7. A vehicle, comprising:
a body;
at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;
a data interface; and
at least one processing device configured to:
receive the at least one acquired image via the data interface;
use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;
determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and
cause a system response based on the determined status.

8. The vehicle of claim 7 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

9. The vehicle of claim 7 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

10. The vehicle of claim 7 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

11. The vehicle of claim 7 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

12. The vehicle of claim 7 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

13. A method for traffic light detection, the method comprising:
acquiring, via at least one image capture device; at least one image of an area forward of a vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;
using at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;
determining, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and
causing a system response based on the determined status.

14. The method of claim 13 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

15. The method of claim 13 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

16. The method of claim 13 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

17. The method of claim 13 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

18. The method of claim 13 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

19. The traffic light detection system of claim 1 , wherein the at least one processing device is further configured to rank the relevancy of the traffic lamp fixtures identified in the at least one acquired image, and the traffic lamp fixture having the highest value of relevancy ranking is determined to be the relevant traffic lamp fixture.

20. The traffic light detection system of claim 1 , further comprising an additional image capture device for detecting at least one feature that relates to a road in an environment of the vehicle.

21. The traffic light detection system of claim 20 , wherein the additional image capture device has a field of view within a range of 40 degrees to 56 degrees.

22. The method of claim 13 , further comprising:
acquiring, via an additional image capture device, an image including a road in an environment of the vehicle; and
detecting in the image at least one feature that relates to the road.

Assignees

• Ben Shalom Itai
• Bagon Eyal
• Taieb Yoav
• Mobileye Vision Technologies Ltd

Inventors

• Ben Shalom Itai
• Bagon Eyal
• Taieb Yoav

Classifications

• G08G1/167

  Driving aids for lane monitoring, lane changing, e.g. blind spot detection · CPC title

• G08G1/165

  for passive traffic, e.g. including static obstacles, trees · CPC title

• B60W2555/60

  Traffic rules, e.g. speed limits or right of way · CPC title

• B60W2554/00

  Input parameters relating to objects · CPC title

• B60W2552/15

  Road slope, i.e. the inclination of a road segment in the longitudinal direction · CPC title