Method and device for augmented depiction

Patent metadata

Field	Value
Publication number	US-10497174-B2
Application number	US-201415026196-A
Country	US
Kind code	B2
Filing date	Sep 13, 2014
Priority date	Oct 1, 2013
Publication date	Dec 3, 2019
Grant date	Dec 3, 2019

Abstract

A method for augmented depiction of at least one piece of additional information in at least one image of a surrounding environment, in particular a vehicle surrounding environment, is disclosed. The image forms a background of a display, where several pieces of additional information to be depicted are compiled into at least one group and are output as a piece of group information in the background.

First claim

The invention claimed is:

1. A method for augmented depiction of additional information in an image of a surrounding environment of a vehicle, comprising the steps of:
compiling first pieces of additional information into a first group, wherein associated real objects of the first pieces of additional information lie ahead in the surrounding environment and are not currently displayed in the image but are to be displayed;
compiling second pieces of additional information into a second group, wherein associated real objects of the second pieces of additional information are currently displayed in the image;
compiling third pieces of additional information, wherein associated real objects of the third pieces of additional information were previously visible in the surrounding environment, into a third group; and
outputting the first group as a first piece of group information and the third group as a third piece of group information in a superimposed manner in the image on a display without location reference to a current reality and the surrounding environment of the vehicle together with the second group as a second piece of group information, wherein the associated real objects of the second pieces of additional information are currently displayed in the image;
wherein respective pieces of at least one of the first group, the second group, and the third group are compiled in a sorted manner according to distances thereof from a position of an observer of the display and/or according to an associated display duration in the image on the display;
wherein the display is a screen or a projection screen or a head up display.

2. The method according to claim 1 , wherein the first pieces of additional information are output such that individual pieces of the first pieces of additional information are output one over the other to partially or completely cover one another and/or one next to the other.

3. The method according to claim 1 , wherein the first pieces of additional information output in the superimposed manner in the image are manipulated manually by a selection function.

4. The method according to claim 1 , wherein the first pieces of additional information are additional objects and/or additional text.

5. A device for implementation of the method according to claim 1 , comprising:
a recording unit, wherein the recording unit records the image of the surrounding environment as a digital image;
a processing unit, wherein the processing unit superimposes the first pieces of additional information, the second pieces of additional information, and the third pieces of additional information into the digital image; and
a display, wherein the display displays the digital image and wherein the display is a screen or a projection screen or a head up display.

6. A method for augmented depiction of additional information in an image of a surrounding environment of a vehicle, comprising the steps of:
compiling first pieces of additional information into a first group, wherein associated real objects of the first pieces of additional information lie ahead in the surrounding environment and are not currently displayed in the image but are to be displayed;
compiling second pieces of additional information into a second group, wherein associated real objects of the second pieces of additional information are currently displayed in the image;
compiling third pieces of additional information, wherein associated real objects of the third pieces of additional information were previously visible in the surrounding environment, into a third group; and
outputting the first group as a first piece of group information and the third group as a third piece of group information in a superimposed manner in the image on a display without location reference to a current reality and the surrounding environment of the vehicle together with the second group as a second piece of group information, wherein the associated real objects of the second pieces of additional information are currently displayed in the image;
wherein respective pieces of the first group, the second group, and the third group are compiled in a sorted manner according to distances thereof from a position of an observer of the display such that a chronological course of the respective pieces is depicted;
wherein the display is a screen or a projection screen or a head up display.

7. A device for implementation of the method according to claim 6 , comprising:
a recording unit, wherein the recording unit records the image of the surrounding environment as a digital image;
a processing unit, wherein the processing unit superimposes the first pieces of additional information, the second pieces of additional information, and the third pieces of additional information into the digital image; and
a display, wherein the display displays the digital image and wherein the display is a screen or a projection screen or a head up display.

Assignees

• Daimler Ag

Inventors

• Gruenler Christian
• Wilke Wilhelm
• Tropper Tobias
• Schatton Adam
• Hammori Markus
• LUETZE Lars
• Necker Marc
• Olszewski Dirk

Classifications

• G01C21/3647

  Guidance involving output of stored or live camera images or video streams · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• B60R2300/308

  by overlaying the real scene, e.g. through a head-up display on the windscreen · CPC title

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3697

  Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence) · CPC title