Head up display and control method thereof

Patent metadata

Field	Value
Publication number	US-11897394-B2
Application number	US-202117380543-A
Country	US
Kind code	B2
Filing date	Jul 20, 2021
Priority date	Aug 27, 2020
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

A head up display for a vehicle including a display device configured to output light forming an image, an optical system configured to control a path of the light such that the image is output towards a light transmission region, and a controller configured to generate the image based on a first view and a second view such that a virtual image is produced on a ground surface in the light transmission region, the first view being towards the ground surface, the second view being towards a 3D space above the ground surface, the first view and the second view being based on an eye-box, the ground surface being in front of the vehicle, and the virtual image including a graphic object having a stereoscopic effect, and control the display device to output the image.

First claim

What is claimed is:

1. A head up display for a vehicle, comprising:
a display device configured to output light forming an image;
an optical system configured to control a path of the light such that the image is output towards a light transmission region; and
a controller configured to,
generate the image based on a first view and a second view such that a virtual image is produced on a ground surface in the light transmission region, the first view being towards the ground surface, the second view being towards a 3D space above the ground surface, the first view and the second view being based on an eye-box, the ground surface being in front of the vehicle, the virtual image including a graphic object having a stereoscopic effect, and
control the display device to output the image,

wherein the optical system is configured to output the virtual image corresponding to the image on the ground surface,
wherein the controller is configured to generate the graphic object with respect to the ground surface by using the optical system, and
wherein the graphic object is generated by,
making the first view and the second view on the basis of the eye-box consistent with each other, and
projecting a first object onto the ground surface using a first conversion matrix, the first object corresponding to the graphic object, and the first conversion matrix corresponding to the first view and the second view.

2. The head up display for a vehicle of claim 1 , wherein
the first view is a driver view of the ground surface;
the second view is a camera view of a virtual camera; and
the controller is configured to generate the image including making the driver view and the camera view consistent with each other.

3. The head up display for a vehicle of claim 2 , wherein
the first object is formed in the 3D space based on the camera view, and
the projecting including projecting the first object onto a 2D plane of the ground surface based on the driver view.

4. The head up display for a vehicle of claim 1 , wherein
the controller is configured to generate the graphic object using characteristics of the optical system, and
the first object is a 3D object.

5. The head up display for a vehicle of claim 4 , wherein the controller is configured to:
generate a projected image by projecting the 3D object onto the ground surface; and
convert the projected image into the image using the characteristics of the optical system.

6. The head up display for a vehicle of claim 4 , wherein the controller is configured to convert the 3D object into the graphic object using a scalar product of the first conversion matrix and a second conversion matrix, the first conversion matrix being configured to project the 3D object onto the ground surface to obtain a projected image, and the second conversion matrix being configured to convert the projected image into the image.

7. The head up display for a vehicle of claim 1 , wherein
the virtual image includes a 2D graphic object formed on a virtual image plane corresponding to the ground surface; and
the graphic object having the stereoscopic effect is a 3D graphic object erected on the virtual image plane.

8. The head up display for a vehicle of claim 7 , wherein the image is a single image including both the 2D graphic object and the 3D graphic object.

9. The head up display for a vehicle of claim 7 , wherein the 2D graphic object includes information related to at least one of a lane, a driving speed or a driving direction, and the 3D graphic object includes information related to at least one of a point of interest (POI), a guiding message, a destination or a peripheral vehicle.

10. The head up display for a vehicle of claim 1 , wherein the light transmission region is at a combiner or a windshield.

11. The head up display for a vehicle of claim 1 , wherein the making the first view and the second view consistent with each other includes configuring a third conversion matrix to be equal to a fourth conversion matrix, the third conversion matrix representing the second view, and the fourth conversion matrix representing the first view.

12. A head up display for a vehicle, comprising:
a display device configured to output an image;
an image forming optical system configured to convey light corresponding to the image through a light transmission region such that a virtual image corresponding to the image appears on a ground surface in the light transmission region, the ground surface being in front of a vehicle; and
a controller configured to,
generate the image based on an eye-box such that a 2D graphic object and a 3D graphic object appear at the ground surface in the light transmission region,
the 2D graphic object corresponding to the ground surface and the 3D graphic object having a stereoscopic effect,
the eye-box being defined based on a viewing angle of a driver of the vehicle, the 3D graphic object corresponding to a 3D object projected onto the ground surface using a first conversion matrix, the first conversion matrix corresponding to a first view and a second view,
the first view being towards the ground surface, the second view being towards a 3D space above the ground surface, and the first view and the second view being based on the eye-box, and
control the display device to output the image.

13. The head up display of claim 12 , wherein the controller is configured to generate the 3D graphic object using characteristics of the image forming optical system.

14. A control method of a head up display for a vehicle, comprising:
generating an image based on a first view and a second view such that a virtual image is produced on a ground surface in a light transmission region, the first view being towards the ground surface, the second view being towards a 3D space above the ground surface, the first view and the second view being based on an eye-box, the ground surface being in front of a vehicle, the virtual image including a graphic object having a stereoscopic effect; and
controlling a display device to output the image to an optical system configured to convey the image to the light transmission region,
wherein the virtual image is produced by an optical system configured to control a path of light such that the image formed by the light is output towards the light transmission region,
wherein the graphic object is generated by using the optical system, and
wherein the graphic object is generated by,
making the first view and the second view on the basis of the eye-box consistent with each other, and
projecting a first object onto the ground surface using a first conversion matrix, the first object corresponding to the graphic object to obtain a projected image, and the first conversion matrix corresponding to the first view and the second view.

15. The method of claim 14 , wherein the generating an image comprises:
converting the projected image into the image based on characteristics of the optical system.

16. The method of claim 14 , wherein
the first object is a 3D object; and
the generating an image comprises generating the graphic object using a scalar product of the first conversion matrix and a second conversion matrix, the first conversion matrix being configured to project the 3D object onto the ground surface to obtain the projected image, and the second conversion matrix being configured to convert the projected image into the image.

17. The method of claim 14 , wherein
the virtual image includes a 2D graphic object formed on a virtual image plane corresponding to the ground surface; and

Assignees

• Naver Labs Corp

Inventors

• Cha Jae Won
• Lee Jeseon
• Kim Kisung
• Park Jongjin
• Jeong Eunyoung
• Shin Yongho

Classifications

• B60K35/28

  characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver · CPC title

• B60K35/231

  characterised by their arrangement or structure for integration into vehicles · CPC title

• B60K35/235

  with means for detecting the driver's gaze direction or eye points · CPC title

• B60K35/211

  producing three-dimensional [3D] effects, e.g. stereoscopic images · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title