Traffic light recognition device and traffic light recognition method

Patent metadata

Field	Value
Publication number	US-10339805-B2
Application number	US-201515743072-A
Country	US
Kind code	B2
Filing date	Jul 13, 2015
Priority date	Jul 13, 2015
Publication date	Jul 2, 2019
Grant date	Jul 2, 2019

Abstract

A traffic light recognition device includes: an imaging attitude setting unit configured to set an imaging direction of the camera on the basis of a position on the image of the traffic light and of a moving direction in the future on the image of the traffic light; a camera attitude controller configured to change the imaging direction of the camera to an imaging direction set by an imaging direction setting unit; and a traffic light recognition unit configured to recognize the traffic light from an image captured in the imaging direction by the camera. The traffic light recognition device is capable of accurately detecting the lighting state of a traffic light without being affected by the attitude of a camera.

First claim

The invention claimed is:

1. A traffic light recognition device, comprising:
a camera mounted on a vehicle and configured to capture an image around the vehicle;
a processor; and
a memory coupled to the processor, the memory storing instructions which, when executed by the processor:
acquire map information around the vehicle;
detect a current position on a map of the vehicle;
estimate a position on an image of a traffic light on a basis of the current position and the map information;
set an imaging direction of the camera on a basis of the position on the image of the traffic light and of a moving direction in the future on the image of the traffic light;
change the imaging direction of the camera to the set imaging direction;
recognize the traffic light from an image captured in the imaging direction by the camera;
set a change point or region at which the imaging direction of the camera is changed, on a basis of the position on the image of the traffic light and of the moving direction in the future on the image of the traffic light; and
change the imaging direction when the vehicle reaches the change point or region.

2. The traffic light recognition device according to claim 1 , wherein the memory further stores instructions which, when executed by the processor:
set an imaging direction of the camera on a basis of the position on the image of the traffic light and of a moving range in the future on the image of the traffic light.

3. The traffic light recognition device according to claim 1 , wherein the memory further stores instructions which, when executed by the processor:
calculate a change amount in the imaging direction from the position on the image of the traffic light and on the moving range in the future on the image of the traffic light, and sets an imaging direction on a basis of an imaging range of the camera and the change amount.

4. The traffic light recognition device according to claim 2 , wherein the memory further stores instructions which, when executed by the processor:
predict a moving range in the future on the image of the traffic light on a basis of a traveling route in the future of the vehicle.

5. The traffic light recognition device according to claim 1 , wherein the memory further stores instructions which, when executed by the processor:
set, when a plurality of traffic lights can be imaged by the camera, an imaging direction of the camera so that the plurality of traffic lights is included on the image.

6. The traffic light recognition device according to claim 1 , wherein the memory further stores instructions which, when executed by the processor:
set, on a basis of a distance from a stop position provided for the traffic light to the vehicle and of a traveling speed of the vehicle, a change restriction area for restricting changing the imaging direction of the camera, and changes the imaging direction of the camera before entering this change restriction area.

7. The traffic light recognition device according to claim 1 , wherein the memory further stores instructions which, when executed by the processor:
set, on a basis of a distance from a stop position provided for the traffic light to the vehicle, and of a traveling speed of the vehicle, and of a calculation cycle to recognize a traffic light, a “change time zone” in the imaging direction of the camera; and
change the imaging direction of the camera within the “change time zone”.

8. A traffic light recognition method, comprising the steps of:
capturing, by an camera, an image around a vehicle;
acquiring map information around the vehicle;
detecting a current position on a map of the vehicle;
estimating a position on an image of a traffic light on a basis of the current position and the map information;
setting an imaging direction of the camera on a basis of the position on the image of the traffic light and of a moving direction in the future on the image of the traffic light;
changing the imaging direction of the camera to a set imaging direction;
recognizing the traffic light from an image captured in the imaging direction by the camera;
setting a change point or region at which the imaging direction of the camera is changed, on a basis of the position on the image of the traffic light and of the moving direction in the future on the image of the traffic light; and
changing the imaging direction of the camera when the vehicle reaches the change point or region.

Assignees

• Nissan Motor

Inventors

• Yamanoi Daiki
• Matsuo Haruo
• Oki Takahiko
• Suzuki Akira

Classifications

• B60R11/04

  Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle · CPC title

• G08G1/09623 Primary

  Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle (G08G1/0967 takes precedence) · CPC title

• G06T2207/30256

  Lane; Road marking · CPC title

• B60W2555/60

  Traffic rules, e.g. speed limits or right of way · CPC title

• H04N5/225

  Electricity · mapped topic