Method for operating a display device in a motor vehicle

Patent metadata

Field	Value
Publication number	US-11836864-B2
Application number	US-202117402838-A
Country	US
Kind code	B2
Filing date	Aug 16, 2021
Priority date	Oct 9, 2017
Publication date	Dec 5, 2023
Grant date	Dec 5, 2023

Abstract

Surroundings data, relating to at least one surrounding area in the surroundings of a motor vehicle situated in a field of vision of a vehicle occupant, are obtained by a sensor system of the motor vehicle. At least one piece of information, which needs to be output to the user, is provided by an information source. The information is at least partially overlaid on a display of the surrounding area by a display device with the type of information presentation and/or the position at, and/or the orientation in, which the information presentation is visualized being dependent on the surroundings data.

First claim

What is claimed is:

1. A method for operating a display device in a motor vehicle, comprising:
capturing surroundings data relating to at least one surrounding area in surroundings of the motor vehicle, situated in a field of vision of a user, by a sensor system of the motor vehicle;
obtaining at least one piece of information, to be output to the user, from an occupant of the motor vehicle; and
visualizing an at least partially overlaid presentation of an information presentation reproducing the at least one piece of information and the at least one surrounding area for the user by the display device with at least one of a type of the information presentation, positioning of the information presentation and presentation orientation of the information presentation being dependent on the surroundings data.

2. The method according to claim 1 , wherein the at least one piece of information relates to an attraction in the surroundings of the motor vehicle.

3. The method according to claim 1 , wherein the display device is a video-based display device,
wherein the visualizing of the at least partially overlaid presentation includes one of
capturing an image of the at least one surrounding area by one of the sensor system and a further sensor system, and displaying the image on the video-based display device with the information presentation overlaid thereon,
overlaying the information presentation via a semitransparent display device with at least part of the at least one surrounding area visible to the user through the semitransparent display device, and
projecting, via a virtual retinal display, the information presentation onto at least one retina of the user.

4. The method according to claim 1 ,
further comprising evaluating the surroundings data to specify at least one object or at least one position, and
wherein the visualizing of the at least partially overlaid presentation is based on a property of the at least one object or the position.

5. The method according to claim 1 ,
further comprising evaluating the surroundings data to specify at least one object, and
wherein the method further comprises determining, based on at least one of a position and an orientation of the at least one object, the at least one of the type of information presentation, the positioning of the information presentation and the presentation orientation of the partially overlaid presentation.

6. A motor vehicle, comprising:
a sensor system configured to capture at least one surrounding area in surroundings of the motor vehicle, situated in a field of vision of a user;
a processor configured to obtain at least one piece of information, to be output to the user, from an occupant of the motor vehicle; and
a display, coupled to the sensor system and the processor, configured to visualize an at least partially overlaid presentation of an information presentation reproducing the at least one piece of information and the at least one surrounding area for the user, with at least one of a type of the information presentation, positioning of the information presentation and presentation orientation of the information presentation being dependent on the surroundings data.

7. The motor vehicle according to claim 6 , wherein the at least one piece of information relates to an attraction in the surroundings of the motor vehicle.

8. The motor vehicle according to claim 6 , wherein the display visualizes the at least partially overlaid presentation by one of
capturing an image of the at least one surrounding area by one of the sensor system and a further sensor system, and displaying the image on the video-based display device with the information presentation overlaid thereon,
overlaying the information presentation via a semitransparent display device with at least part of the at least one surrounding area visible to the user through the semitransparent display device, and
projecting, via a virtual retinal display, the information presentation onto at least one retina of the user.

9. The motor vehicle according to claim 6 , wherein the processor is further configured to
evaluate the surroundings data to specify at least one object or at least one position, and
visualize the at least partially overlaid presentation based on a property of the at least one object or the position.

10. The motor vehicle according to claim 6 , wherein the processor is further configured to
evaluate the surroundings data to specify at least one object, and
determine, based on at least one of a position and an orientation of the at least one object, the at least one of the type of information presentation, the positioning of the information presentation and the presentation orientation of the partially overlaid presentation.

Assignees

• Audi Ag

Inventors

• Kuehne Marcus
• Profendiner Daniel
• Wollny Nils

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T17/05

  Geographic models · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title