Road marking recognition device

Patent metadata

Field	Value
Publication number	US-10679077-B2
Application number	US-201715784457-A
Country	US
Kind code	B2
Filing date	Oct 16, 2017
Priority date	Oct 17, 2016
Publication date	Jun 9, 2020
Grant date	Jun 9, 2020

Abstract

A road marking recognition device recognizes a road marking from an image acquired by imaging a road surface of a road on which a vehicle is traveling. The road marking recognition device includes: a storage unit configured to store a plurality of templates each of which corresponds to a corresponding one of plurality of feature portions of a road marking as a recognition target and between which a relative positional relationship is known; and a recognition unit configured to detect a second feature portion corresponding to a second template among the plurality of templates when the first feature portion is detected from the image.

First claim

What is claimed is:

1. A road marking recognition device that recognizes a road marking from an image acquired by imaging a road surface of a road on which a vehicle is traveling, the road marking recognition device comprising:
a storage unit that includes a database and processing circuitry, the storage unit configured to store at least one direct template and a plurality of second templates, each of the at least one direct template and each of the plurality of the second templates corresponds to a corresponding one of a plurality of feature portions of a target road marking and the plurality of second templates being such that a relative positional relationship is known, the target road marking being a road marking which is a recognition target; and
an electronic control unit configured to detect a second feature portion corresponding to a second template among the plurality of second templates when a first feature portion corresponding to a first trigger template among the plurality of second templates is detected from the image, the second template among the plurality of second templates being located on a front side of the first feature portion in a traveling direction of the vehicle based on at least one of a yaw rate information of an internal sensor, a speed rate information of another internal sensor, and a temporal change of a position information of the vehicle, and configured to determine that the target road marking is recognized when a third feature portion corresponding to the at least one direct template is detected from the image,
wherein the electronic control unit is configured to start detection of the first feature portion based on the position information of the vehicle and map information which includes information related to position of the road marking.

2. The road marking recognition device according to claim 1 , wherein the electronic control unit is configured to determine that the target road marking is recognized when the second feature portion is detected.

3. A road marking recognition device mounted in a vehicle including a camera configured to acquire an image by imaging a road surface of a road on which the vehicle is traveling, the road marking recognition device comprising:
a storage unit that includes a database and processing circuitry, the storage unit configured to store at least one direct template, a plurality of second templates, and a relative positional relationship between the plurality of second templates, each of the at least one direct template and the plurality of second templates corresponds to a corresponding one of a plurality of feature portions of a target road marking, the target road marking being a road marking which is a recognition target; and
at least one electronic control unit configured to:
detect a first feature portion corresponding to a first trigger template among the plurality of second templates from a first image captured by the camera,
detect a second feature portion corresponding to a second template among the plurality of second templates when the first feature portion is detected from the image, the second template among the plurality of second templates being located on a front side of the first feature portion in a traveling direction of the vehicle based on at least one of a yaw rate information of an internal sensor, a speed rate information of another internal sensor, and a temporal change of a position information of the vehicle, and
determine that the target road marking is recognized when a third feature portion corresponding to the at least one direct template is detected from the image,

wherein the at least one electronic control unit is configured to start detection of the first feature portion based on the position information of the vehicle and map information which includes information related to position of the road marking.

4. The road marking recognition device according to claim 3 , wherein
the at least one electronic control unit is configured to determine that the target road marking is recognized when the second feature portion is detected.

5. The road marking recognition device according to claim 3 , wherein
the at least one electronic control unit is configured to:
detect a candidate portion which is a candidate for the second feature portion, the candidate portion being a portion having a feature matching the second template among the plurality of second templates; and
determine that the candidate portion is the second feature portion when a position of the candidate portion is located in an allowable range which is set using a relative position between the first trigger template and the second template among the plurality of second templates.

6. The road marking recognition device according to claim 3 , wherein
the at least one electronic control unit is configured to detect the second feature portion from a second image captured after the first image is captured.

7. The road marking recognition device according to claim 3 , wherein
the second template among the plurality of second templates is set to correspond to a portion located on a front side of the first feature portion in the traveling direction of the vehicle.

Assignees

• Toyota Motor Co Ltd
• Univ Tokyo
• National Univ Corporation Tokyo Univ Of Agriculture And Technology

Inventors

• Kinoshita Toshiki
• Ito Takuma
• Nakamura Satoshi
• Kamata Minoru
• Raksincharoensak Pongsathorn
• Shimizu Tsukasa

Classifications

• G06K9/00798

  Physics · mapped topic

• G08G1/09623

  Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle (G08G1/0967 takes precedence) · CPC title

• G06K9/6271

  Physics · mapped topic

• G06T2207/30256

  Lane; Road marking · CPC title

• G06K9/00818 Primary

  Physics · mapped topic