Method and apparatus with road line detection

Patent metadata

Field	Value
Publication number	US-10970565-B2
Application number	US-201916259066-A
Country	US
Kind code	B2
Filing date	Jan 28, 2019
Priority date	Sep 7, 2018
Publication date	Apr 6, 2021
Grant date	Apr 6, 2021

Abstract

Disclosed is a method and apparatus for detecting a road line includes segmenting a driving image data into a plurality of segmentation areas, determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas, extracting at least one straight road line from the segmentation area, detecting a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area, detecting the road line of the driving image data by connecting partial lines corresponding to the segmentation areas, and indicating the detected road line.

First claim

What is claimed is:

1. A processor-implemented method of detecting a road line, comprising:
segmenting a captured driving image data into a plurality of segmentation areas;
determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas;
extracting at least one straight road line from the segmentation area;
detecting a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area; and
detecting the road line of the driving image data by connecting partial lines corresponding to the segmentation areas,
wherein the determining of the candidate vanishing-point area comprises:
verifying whether the segmentation area is a lowermost segmentation area of the driving image data; and
extracting, when the segmentation area is not the lowermost segmentation area, a candidate vanishing-point area corresponding to the segmentation area based on a partial vanishing point determined in a preceding segmentation area adjacent to the segmentation area.

2. The method of claim 1 , further comprising indicating the detected road line.

3. The method of claim 1 , further comprising:
extracting, when the segmentation area is the lowermost segmentation area, a candidate vanishing-point area corresponding to the segmentation area irrespective of a preceding segmentation area adjacent to the segmentation area.

4. The method of claim 1 , wherein the extracting of the candidate vanishing-point area comprises:
defining a bounding box having a predetermined distance from the partial vanishing point determined in the preceding segmentation area; and
extracting the candidate vanishing-point area using the bounding box.

5. The method of claim 1 , wherein the extracting of the candidate vanishing-point area comprises:
extracting a candidate vanishing-point area corresponding to the segmentation area based on the partial vanishing point determined in the preceding segmentation area and a driving parameter corresponding to the driving image data.

6. The method of claim 1 , wherein the segmenting comprises:
segmenting the driving image data into the segmentation areas horizontally while moving from a lowermost position toward a top of the driving image data.

7. The method of claim 1 , wherein the extracting of the at least one straight road line comprises:
extracting a line detection area from the segmentation area; and
extracting the at least one straight road line from the line detection area.

8. The method of claim 7 , wherein the extracting of the line detection area comprises:
extracting the line detection area based on a partial vanishing point corresponding to a preceding segmentation area of the segmentation area and a partial line corresponding to the preceding segmentation area.

9. The method of claim 1 , wherein the detecting of the partial line comprises:
determining a partial vanishing point corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area; and
detecting a partial line corresponding to the segmentation area based on the partial vanishing point.

10. The method of claim 9 , wherein the detecting of the partial line comprises:
detecting a straight road line passing through the partial vanishing point among the at least one straight road line as the partial line.

11. The method of claim 9 , wherein the detecting of the partial line comprises:
detecting the partial line corresponding to the segmentation area based on whether the partial line is a continuation of a partial line corresponding to a preceding segmentation area of the segmentation area.

12. A processor-implemented method of detecting a road line, comprising:
segmenting a captured driving image data into a plurality of segmentation areas;
determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas based on a partial vanishing point corresponding to a segmentation area adjacent to the segmentation area;
determining a line detection area corresponding to the segmentation area based on a partial line corresponding to the adjacent segmentation area and the partial vanishing point corresponding to the segmentation area adjacent to the segmentation area;
extracting at least one straight road line from the line detection area;
determining a partial vanishing point corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area;
detecting a partial line corresponding to the segmentation area based on the determined partial vanishing point corresponding to the segmentation area; and
detecting a road line of the driving image data by connecting partial lines corresponding to the segmentation areas.

13. The method of claim 12 , wherein the determining of the candidate vanishing-point area comprises:
extracting a candidate vanishing-point area corresponding to the segmentation area based on the partial vanishing point corresponding to the adjacent segmentation area and a driving parameter corresponding to the driving image data.

14. The method of claim 12 , wherein the extracting of the at least one straight road line comprises:
extracting the line detection area from the segmentation area; and
extracting the at least one straight road line from the line detection area.

15. The method of claim 14 , wherein the extracting of the line detection area comprises:
extracting the line detection area based on the partial vanishing point corresponding to the adjacent segmentation area and a partial line corresponding to the adjacent segmentation area.

16. The method of claim 12 , wherein the detecting of the partial line comprises:
detecting a straight road line passing through the partial vanishing point corresponding to the segmentation area among the at least one straight road line as the partial line.

17. The method of claim 12 , wherein the detecting of the partial line comprises:
detecting the partial line corresponding to the segmentation area based on whether the partial line corresponding to the segmentation area is a continuation of a partial line corresponding to a preceding segmentation area.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

19. A detection apparatus for detecting a road line, comprising:
a processor configured to:
segment a captured driving image data into a plurality of segmentation areas;
determine a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas by:
a verification of whether the segmentation area is a lowermost segmentation area of the driving image data;
an extraction, when the segmentation area is the lowermost segmentation area, of a candidate vanishing-point area corresponding to the segmentation area irrespective of a preceding segmentation area adjacent to the segmentation area; and
an extracting, when the segmentation area is not the lowermost segmentation area, of a candidate vanishing-point area corresponding to the segmentation area based on a partial vanishing point determined in a preceding segmentation area adjacent to the segmentation area;

extract at least one straight road line from the segmentation area;
detect a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the c

Assignees

• Samsung Electronics Co Ltd

Inventors

• Ahn Minsu
• Kim Jiyeon

Classifications

• G06T2207/30256

  Lane; Road marking · CPC title

• G06V20/588 Primary

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06T7/11 Primary

  Region-based segmentation · CPC title

• G06T7/187

  involving region growing; involving region merging; involving connected component labelling · CPC title

• G06K9/00798 Primary

  Physics · mapped topic