Method and device for detecting drivable region of road

Patent metadata

Field	Value
Publication number	US-9242601-B2
Application number	US-201314034689-A
Country	US
Kind code	B2
Filing date	Sep 24, 2013
Priority date	Sep 24, 2012
Publication date	Jan 26, 2016
Grant date	Jan 26, 2016

Abstract

A method and a device are disclosed for detecting a drivable region of a road, the method comprising the steps of: deriving a disparity map from a gray-scale map including the road and detecting the road from the disparity map; removing a part with a height above the road greater than a predetermined height threshold from the disparity map so as to generate a sub-disparity map; converting the sub-disparity map into a U-disparity map; detecting the drivable region from the U-disparity map; and converting the drivable region detected from the U-disparity map into the drivable region within the gray-scale map.

First claim

What is claimed is:

1. A method for detecting a drivable region of a road, comprising the steps of:
generating, using a camera, a gray-scale map including the road;
deriving a disparity map from the gray-scale map including the road and detecting the road from the disparity map;
removing, using a processor, a part with a height above the road greater than a predetermined height threshold from the disparity map so as to generate a sub-disparity map;
converting, using the processor, the sub-disparity map into a U-disparity map;
detecting, using the processor, the drivable region from the U-disparity map; and
converting the drivable region detected from the U-disparity map into the drivable region within the gray-scale map,
the detecting including performing a first detecting operation, the first detecting operation including detecting a specific region from the U-disparity map as the drivable region by shifting a detection window with a predetermined size from an initial position in the U-disparity map,
the performing the first detecting operation including,
(a) horizontally shifting the detection window along a direction of rows to the left from the initial position, and stopping the shifting of the detection window and recording the stop position of the detection window as a left stop position of the said row if a first determined condition is met, horizontally shifting the detection window along a direction of rows to the right from the initial position, and stopping the shifting of the detection window and recording the stop position of the detection window as a right stop position of the said row if a second determined condition is met;
(b) shifting the detection window upward by a distance equal to the height of the detection window, and repeating step (a);
(c) repeating step (b) until the detection window reaches a top edge of the U-disparity map or the left stop position and the right stop position in the same row are adjacent to each other; and
(d) extracting a region covered by the shifted detection windows from the U-disparity map as the drivable region,
wherein the first determined condition is one of the condition that the number of the active points within the detection window is greater than a predetermined number threshold; the condition that the detection window reaches a left edge of the U-disparity map, even though the number of the active points within the detection window is not greater than the predetermined number threshold; and the condition that the horizontal distance between the position of the detection window and the left stop position of the previous row is less than a first distance threshold, even though the detection window does not reach the left edge of the U-disparity map and the number of the active points within the detection window is not greater than the predetermined number threshold,
wherein the second determined condition is one of the condition that the number of the active points within the detection window is greater than a predetermined number threshold; the condition that the detection window reaches a right edge of the U-disparity map, even though the number of the active points within the detection window is not greater than the predetermined number threshold; and the condition that the horizontal distance between the position of the detection window and the right stop position of the previous row is less than a second distance threshold, even though the detection window does not reach the right edge of the U-disparity map and the number of the active points within the detection window is not greater than the predetermined number threshold.

2. The method for detecting a drivable region of a road according to claim 1 , wherein the step of detecting the road from the disparity map comprises the steps of:
converting the disparity map into a V-disparity map; and
fitting a road line representing the road in the V-disparity map.

3. The method for detecting a drivable region of a road according to claim 2 , wherein the sub-disparity map is generated by removing a part that is located above the road line and has a distance from the road line greater than the predetermined height threshold from the disparity map.

4. The method for detecting a drivable region of a road according to claim 1 ,
wherein the step of detecting the drivable region from the U-disparity map comprises the step of:
selecting an initial position within the drivable region from the U-disparity map, and

wherein the specific region includes the initial position, and the number of active points with a brightness greater than a brightness threshold within the detection window is less than a predetermined number threshold during the time when the detection window is shifted in the specific region.

5. The method for detecting a drivable region of a road according to claim 2 , wherein the step of converting the drivable region detected from the U-disparity map into the drivable region within the gray-scale map comprises the steps of:
obtaining coordinates of points within the drivable region detected from the U-disparity map;
calculating coordinates of points within the drivable region of the gray-scale map based on the coordinates of the points, by an expression for fitting the road line in the V-disparity map; and
extracting the drivable region within the gray-scale map based on the coordinates of the points within the drivable region of the gray-scale map.

6. A device for detecting a drivable region of a road, comprising:
a road detecting apparatus configured to derive a disparity map from a gray-scale map including the road and detect the road from the disparity map;
a sub-disparity map generating apparatus configured to remove a part with a height above the road greater than a predetermined height threshold from the disparity map so as to generate a sub-disparity map;
a U-disparity map generating apparatus configured to convert the sub-disparity map into a U-disparity map;
a U-disparity map detecting apparatus configured to detect the drivable region from the U-disparity map; and
a drivable region converting apparatus configured to convert the drivable region detected from the U-disparity map into the drivable region within the gray-scale map,
the road detecting apparatus being further configured to perform the detecting by performing a first detecting operation, the first detecting operation including detecting a specific region from the U-disparity map as the drivable region by shifting a detection window with a predetermined size from an initial position in the U-disparity map,
the road detecting apparatus being further configured to perform the first detecting operation by
(a) horizontally shifting the detection window along a direction of rows to the left from the initial position, and stopping the shifting of the detection window and recording the stop position of the detection window as a left stop position of the said row if a first determined condition is met, horizontally shifting the detection window along a direction of rows to the right from the initial position, and stopping the shifting of the detection window and recording the stop position of the detection window as a right stop position of the said row if a second determined condition is met,
(b) shifting the detection window upward by a distance equal to the height of the detection window, and repeating step (a),
(c) repeating step (b) until the detection window reaches a top edge of the U-disparity map or the left stop position and the right stop position in the same row are adjacent to each other, and
(d) extracting a region covered by the shifted detection windows from the U-disparity map as the drivable region,

wherein the first determined condition is one of the condition that the

Assignees

• You Ganmei
• Lu Yaojie
• Shi Zhongchao
• Wang Gang
• Ricoh Co Ltd

Inventors

• You Ganmei
• Lu Yaojie
• Shi Zhongchao
• Wang Gang

Classifications

• B60Q9/008 Primary

  for anti-collision purposes · CPC title

• G06V20/56 Primary

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V10/507

  Summing image-intensity values; Histogram projection analysis · CPC title