Method for generating a virtual image of vehicle surroundings

Patent metadata

Field	Value
Publication number	US-10412359-B2
Application number	US-201615735519-A
Country	US
Kind code	B2
Filing date	May 11, 2016
Priority date	Jun 11, 2015
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

The invention relates to a method for generating a virtual image of vehicle surroundings, in which real images of the vehicle surroundings are recorded by means of one or more cameras positioned on the vehicle and in order to generate the virtual image individual pixels from the real images captured by means of the cameras are projected onto projection points (Pi) in a three-dimensional surroundings model of the vehicle surroundings.

First claim

The invention claimed is:

1. A method for generating a virtual image of vehicle surroundings, said method comprising:
recording real images of the vehicle surroundings utilizing one or more cameras positioned on the vehicle; and
projecting individual pixels from the real images captured by the one or more cameras onto projection points (P i ) in a three-dimensional surroundings model of the vehicle surroundings,
wherein
the projection points (P i ) are positioned equidistant to one another in a first spatial direction (x) and a second spatial direction (y) which is orthogonal to the first spatial direction, and
the position (z Pi ) of the projection points (P i ) in a third spatial direction (z) is defined as a function of a distance (d Pi ) from the vehicle in the surroundings model.

2. The method according to claim 1 , wherein the position of the projection points (Pt) in the three-dimensional space is defined by Cartesian coordinates.

3. The method according to claim 2 , wherein the projection points (P i ) are positioned equidistant to one another with respect to a coordinate plane (E xy ), which corresponds to a road surface in the surroundings model.

4. The method according to claim 3 , wherein the size of the equidistant distances (Δx; Δy) of the projection points (P i ) in the first and/or in the second spatial direction (x, y) is defined as a function of at least one modifiable parameter.

5. The method according to claim 1 , wherein the position (z Pi ) of the projection points (P i ) in the third spatial direction (z) is also defined as a function of a predetermined limit (d max ) for the distance (d pi ) from the vehicle and/or as a function of a predetermined slope parameter (n).

6. The method according to claim 5 , wherein a maximum value (z max ) for the position (z Pi ) of the projection points (P i ) in the third spatial direction (z) is also predetermined for calculating the surroundings model.

7. The method according to claim 6 , wherein at least one first region (V, H, L, R) about the vehicle is defined in the surroundings model, wherein in this region the distance (d Pi ) of the projection points (P i ) from the vehicle corresponds to the lateral distance (d Pi,R ) of the projection points (P i,R ) in this region from a vehicle edge (K R ).

8. The method according to claim 7 , wherein at least one second region (VL, VR, HL, HR) about the vehicle is defined in the surroundings model, wherein in this region the distance (d Pi ) of the projection points (P i ) from the vehicle corresponds to the radial distance (d Pi,HR ) of the projection points (d Pi,HR ) in this region from a vehicle corner point (E HR ).

9. A device for generating a virtual image of vehicle surroundings, comprising:
one or more cameras positioned on the vehicle for recording real images of the vehicle surroundings; and
a processor configured to generate the virtual image by projecting pixels from the real images captured by the one or more cameras onto projection points (Pi) in a three-dimensional surroundings model of the vehicle surroundings, wherein
the processor is further configured to project individual pixels from the real images captured by the one or more cameras onto projection points (P i ) in a three-dimensional surroundings model of the vehicle surroundings such that the projection points (P i ) are positioned equidistant to one another in at least one first spatial direction (x) and one second spatial direction (y) which is orthogonal to the first spatial direction, and
the position (z Pi ) of the projection points (P i ) in a third spatial direction (z) is defined as a function of a distance (d Pi ) from the vehicle in the surroundings model.

Assignees

• Conti Temic Microelectronic Gmbh

Inventors

• Friebe Markus
• Garcia Marques Rodrigo

Classifications

• G06T15/10 Primary

  Geometric effects · CPC title

• G06T2215/12

  Shadow map, environment map · CPC title

• H04N13/111 Primary

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• B60R2300/607

  from a bird's eye viewpoint · CPC title