Method and device for analyzing trafficability

Patent metadata

Field	Value
Publication number	US-9690993-B2
Application number	US-201314647958-A
Country	US
Kind code	B2
Filing date	Dec 6, 2013
Priority date	Dec 11, 2012
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

A method and a device for analyzing trafficability use a computer to perform the following steps:
receiving image data representing an image of surroundings in front of a vehicle, analyzing the image data to identify different zones in the image of the surroundings, and analyzing the identified different zones in terms of trafficability thereof for the vehicle.

First claim

The invention claimed is:

1. A method for a driver assistance system of a subject vehicle, comprising the steps:
with a sensor system of the subject vehicle, producing image data comprising plural image pixels and three-dimensional position data respectively associated with each one of the image pixels, wherein the image pixels represent at least one image of an external environment in front of the subject vehicle;
with a processor arrangement of the subject vehicle, analyzing the image data including the three-dimensional position data to calculate respective spatial positions of the image pixels in three-dimensional space, and from the spatial positions of the image pixels determining an estimated ground plane in the at least one image;
with the processor arrangement, classifying the image pixels into ground plane pixels and other pixels based on the three-dimensional position data, wherein the ground plane pixels belong to the estimated ground plane and the other pixels do not belong to the estimated ground plane in the at least one image;
with the processor arrangement, analyzing only the ground plane pixels and not the other pixels to segment the estimated ground plane into ground plane zones that are distinguished from one another in the at least one image based on respective characteristic features of the ground plane pixels of the ground plane zones in the image data;
with the processor arrangement, analyzing the image data to determine and assign, respectively to the ground plane zones, respective trafficability values that indicate whether the subject vehicle can safely drive in the respective areas of the external environment represented by the respective ground plane zones in the at least one image; and
with the driver assistance system, outputting an information to a driver of the subject vehicle or autonomously actuating a vehicle control of the subject vehicle based and dependent on the trafficability values.

2. The method according to claim 1 , wherein each one of the trafficability values is respectively an indication that the associated respective area of the external environment is either trafficable or non-trafficable.

3. The method according to claim 1 , wherein the trafficability value of a first one of the ground plane zones is determined by identifying a driving activity of an other vehicle in a first one of the areas of the external environment represented by the first ground plane zone, and dependent thereon setting the trafficability value of the first ground plane zone to indicate whether the subject vehicle can safely drive in the first area represented by the first ground plane zone.

4. The method according to claim 3 , wherein the trafficability value of the first ground plane zone is set to indicate that the subject vehicle can safely drive in the first area when it was identified that the other vehicle safely drove in the first area.

5. The method according to claim 3 , further comprising identifying a second one of the ground plane zones of which the characteristic features are similar to the characteristic features of the first ground plane zone, and wherein the trafficability value of the second ground plane zone is determined by setting the trafficability value of the second ground plane zone to be equal to the trafficability value determined for the first ground plane zone.

6. The method according to claim 3 , wherein the trafficability value of the first ground plane zone is determined dynamically and changes over time dependent on a time-varying result of the identifying of the driving activity of the other vehicle.

7. The method according to claim 1 , wherein the respective trafficability value of a respective one of the ground plane zones is determined by identifying whether an obstacle protruding upwardly from the estimated ground plane exists in the respective area of the external environment represented by the respective ground plane zone, and dependent thereon setting the respective trafficability value to indicate that the subject vehicle cannot safely drive in the respective area.

8. The method according to claim 7 , wherein the three-dimensional position data is determined by a stereovision analysis of a plurality of the images, and the obstacle is detected from the three-dimensional position data.

9. The method according to claim 1 , wherein the three-dimensional position data is determined by a stereovision analysis of a plurality of the images, and wherein the ground plane pixels represent the estimated ground plane as a two-dimensional plane.

10. The method according to claim 1 ,
wherein the three-dimensional position data is determined by a stereovision analysis of a plurality of the images, and
wherein the characteristic features of the ground plane pixels of the ground plane zones, based on which the estimated ground plane is segmented, include a respective height variance of the ground plane pixels respectively allocated to different ones of the ground plane zones.

11. The method according to claim 1 , wherein the characteristic features of the ground plane pixels of the ground plane zones, based on which the estimated ground plane is segmented, include at least one of a color, a saturation, an intensity or a texture of a portion of the at least one image represented by the ground plane pixels.

12. The method according to claim 1 , further comprising, with the processor arrangement, for each respective portion of any one of the ground plane zones having any of the other pixels located above the respective portion in the three-dimensional space, assigning to the respective portion a respective one of the trafficability values comprising an indication that a respective partial area of the external environment represented by the respective portion of the ground plane zone in the at least one image is non-trafficable.

13. A device for a driver assistance system of a subject vehicle, comprising:
a sensor system that is configured and arranged to produce image data comprising plural image pixels and three-dimensional position data respectively associated with each one of the image pixels, wherein the image pixels represent at least one image of an external environment in front of the subject vehicle;
a processor arrangement that is configured and arranged to perform a method including:
analyzing the image data including the three-dimensional position data to calculate respective spatial positions of the image pixels in three-dimensional space, and from the spatial positions of the image pixels determining an estimated ground plane in the at least one image;
classifying the image pixels into ground plane pixels and other pixels based on the three-dimensional position data, wherein the ground plane pixels belong to the estimated ground plane and the other pixels do not belong to the estimated ground plane in the at least one image;
analyzing only the ground plane pixels and not the other pixels to segment the estimated ground plane into ground plane zones that are distinguished from one another in the at least one image based on respective characteristic features of the ground plane pixels of the ground plane zones in the image data; and
analyzing the image data to determine and assign, respectively to the ground plane zones, respective trafficability values that indicate whether the subject vehicle can safely drive in the respective areas of the external environment represented by the respective ground plane zones in the at least one image;

and
an output configured and arranged to output an information to a driver of the subject vehicle or to output a control signal configured to autonomously actuat

Assignees

• Conti Temic Microelectronic Gmbh

Inventors

• Grewe Ralph
• Hegemann Stefan
• Zobel Matthias

Classifications

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06V20/56 Primary

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G06K9/46

  Physics · mapped topic