Augmented reality HUD display method and device for vehicle

Patent metadata

Field	Value
Publication number	US-9690104-B2
Application number	US-201514846781-A
Country	US
Kind code	B2
Filing date	Sep 6, 2015
Priority date	Dec 8, 2014
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

An augmented reality head-up display (HUD) display method for a vehicle includes: detecting a position of an object outside of the vehicle at which a driver of the vehicle is looking; detecting a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle; extracting augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position; correcting one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye, the error correction parameters varying from one another; receiving the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye; and displaying augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

First claim

What is claimed is:

1. An augmented reality head-up display (HUD) display method for a vehicle, the method comprising:
detecting, by a controller, a position of an object outside of the vehicle at which a driver of the vehicle is looking;
detecting, by the controller, a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;
extracting, by the controller, augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position;
correcting, by the controller, one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye based on distance information between the eye and the object, the error correction parameters varying from one another;
receiving, by the controller, the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye; and
displaying, by the controller, augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

2. The method of claim 1 , wherein the correcting of the one or more errors comprises:
detecting a position of a plurality of objects outside of the vehicle;
setting a first correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a first object of the plurality of objects and one or more errors in the augmented reality HUD display coordinates of the eye while the driver is viewing the first object; and
setting a second correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a second object of the plurality of objects and the augmented reality HUD display coordinates of the eye while the driver is viewing the second object,
wherein the first object is an external object that is a first distance away from the eye of the driver, the second object is an external object that is a second distance away from the eye of the driver that is shorter than the first distance, and the second correction parameter is set to a lower error correction value than the first correction parameter.

3. The method of claim 1 , further comprising:
detecting, by the controller, the position of the object using a radar sensor or a lidar sensor.

4. The method of claim 1 , further comprising:
detecting, by the controller, the position of the eye using a camera.

5. The method of claim 1 , wherein the correcting of the one or more errors comprises:
low-pass filtering the one or more errors in the augmented reality HUD display coordinates of the object and the one or more errors in the augmented reality HUD display coordinates of the eye,
wherein a cut-off frequency given as a first correction parameter for the low-pass filtering is lower than a cut-off frequency given as a second correction parameter for the low-pass filtering.

6. The method of claim 1 , wherein HUD display information corresponding to the external object information includes speed information of the object or navigation information of the object.

7. The method of claim 6 , wherein the navigation information includes turn-by-turn (TBT) information.

8. An augmented reality HUD display device for a vehicle, the device comprising:
an object detection sensor detecting a position of an object outside of the vehicle at which a driver of the vehicle is looking;
an eye position detector detecting a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;
an augmented reality display coordinates extractor extracting a augmented reality HUD display coordinates the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye position;
an error correction module correcting one or more errors in the augmented reality HUD display coordinates of the object and one or more errors in the augmented reality HUD display coordinates of the eye using an error correction parameter for the augmented reality HUD display coordinates of the object and an error correction parameter for the augmented reality HUD display coordinates of the eye based on distance information between the eye and the object, the error correction parameters varying from one another; and
a graphics display unit receiving, from the error correction module, the corrected augmented reality HUD display coordinates of the object and the corrected augmented reality HUD display coordinates of the eye and displaying augmented reality HUD graphics of the external object information on the windshield based on the received corrected augmented reality HUD display coordinates.

9. The device of claim 8 , wherein:
the object detection sensor detects a position of a plurality of objects outside of the vehicle; and
the error correction module sets a first correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a first object of the plurality of objects and one or more errors in augmented reality HUD display coordinates of the eye while the driver is viewing the first object and a second correction parameter for correcting one or more errors in augmented reality HUD display coordinates of a second object of the plurality of objects and augmented reality HUD display coordinates of the eye while the driver is viewing the second object,
wherein the first object is an external object that is a first distance away from the eye of the driver, the second object is an external object that is a second distance away from the eye of the driver that is shorter than the first distance, and the second correction parameter is set to a lower error correction value than the first correction parameter.

10. The device of claim 8 , wherein the object detection sensor includes a radar sensor or a lidar sensor.

11. The device of claim 8 , wherein the eye position detector includes a camera.

12. The device of claim 8 , wherein the error correction module includes a low-pass filter, and a cut-off frequency given as a first correction parameter for the low-pass filter is lower than a cut-off frequency given as a second correction parameter for the low-pass filter.

13. The device of claim 8 , wherein HUD display information corresponding to the external object information includes speed information of the object or navigation information of the object.

14. The device of claim 13 , wherein the navigation information includes TBT information.

15. A non-transitory computer readable medium containing program instructions for an augmented reality HUD display method for a vehicle, the computer readable medium comprising:
program instructions that detect a position of an object outside of the vehicle at which a driver of the vehicle is looking;
program instructions that detect a position of an eye of the driver while the driver is viewing external object information displayed on a windshield of the vehicle;
program instructions that extract augmented reality HUD display coordinates of the object based on the detected object position and augmented reality HUD display coordinates of the eye based on the detected eye pos

Assignees

• Hyundai Motor Co Ltd

Inventors

• Kim Sung Un

Classifications

• G02B27/01

  Head-up displays · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title