Method for providing composite image based on optical transparency and apparatus using the same

Patent metadata

Field	Value
Publication number	US-10670866-B2
Application number	US-201816001625-A
Country	US
Kind code	B2
Filing date	Jun 6, 2018
Priority date	Jun 13, 2017
Publication date	Jun 2, 2020
Grant date	Jun 2, 2020

Abstract

Disclosed herein are a method for providing a composite image based on optical transparency and an apparatus for the same. The method includes supplying first light of a first light source for projecting a virtual image and second light of a second light source for tracking eye gaze of a user to multiple point lights based on an optical waveguide; adjusting the degree of light concentration of any one of the first light and the second light based on a micro-lens array and outputting the first light or the second light, of which the degree of light concentration is adjusted; tracking the eye gaze of the user by collecting the second light reflected from the pupil of the user based on the optical waveguide; and combining an external image with the virtual image based on the tracked eye gaze and providing the combined image to the user.

First claim

What is claimed is:

1. A method for providing a composite image based on optical transparency, comprising:
supplying first light of a first light source for projecting a virtual image and second light of a second light source for tracking an eye gaze of a user to multiple point lights based on an optical waveguide having a bidirectional propagation characteristic, the multiple point lights projecting the first light and the second light;
adjusting a degree of light concentration of any one of the first light and the second light projected by the multiple point lights, using a micro-lens array and outputting the first light or the second light, of which the degree of light concentration is adjusted;
collecting the second light reflected from a pupil of the user based on the optical waveguide, thereby tracking the eye gaze of the user; and
combining an external image with the virtual image based on the tracked eye gaze and providing the combined image to the user,
wherein a transparent backlight panel including the optical waveguide, the micro-lens array, and a transparent image display panel for displaying the virtual image are included in a transparent panel of a wearable display, which is located directly in front of the pupil of the user.

2. The method of claim 1 , wherein supplying the first light and the second light comprises individually controlling an intensity of the first light supplied to each of the multiple point lights by adjusting diameters of some of multiple paths corresponding to the optical waveguide.

3. The method of claim 2 , wherein supplying the first light and the second light comprises individually controlling a characteristic of the first light supplied to each of the multiple point lights based on a multiple-layer structure using multiple transparent backlight panels.

4. The method of claim 1 , wherein the micro-lens array is configured with multiple lenses, thicknesses of which are controllable in real time.

5. The method of claim 4 , wherein the multiple lenses are individually controlled in response to a control signal for each of multiple groups generated based on the multiple lenses.

6. The method of claim 1 , further comprising:
calibrating a focus of a composite image projected onto the pupil of the user using an additional micro-lens array located between the image display panel and the pupil of the user.

7. The method of claim 1 , wherein the transparent panel of the wearable display is in a form of a flat surface or a curved surface.

8. The method of claim 1 , wherein outputting the first light or the second light, of which the degree of light concentration is adjusted, comprises:
performing, by the micro-lens array, at least one of a convergence function and a divergence function, thereby adjusting the degree of light concentration such that the first light has a same property as natural light; and
performing, by the micro-lens array, at least one of the convergence function and the divergence function, thereby adjusting the degree of light concentration such that a transmissivity with which the second light penetrates through the image display panel is increased and such that a collection rate at which the second light reflected from the pupil of the user is collected is increased.

9. The method of claim 4 , wherein outputting the first light or the second light, of which the degree of light concentration is adjusted, comprises:
deactivating a lens, a refractive index of which exceeds a user recognition level, among the multiple lenses.

10. The method of claim 1 , wherein tracking the eye gaze of the user comprises collecting the reflected second light using an end part of the optical waveguide that is extended so as to be closer to the pupil of the user.

11. A wearable display based on optical transparency, comprising:
a transparent backlight panel for supplying first light of a first light source for projecting a virtual image, which is to be combined with an external image, and second light of a second light source for tracking an eye gaze of a user to multiple point lights based on an optical waveguide having a bidirectional propagation characteristic, the multiple point lights projecting the first light and the second light;
a micro-lens array for adjusting a degree of light concentration of any one of the first light and the second light projected by the multiple point lights and outputting the first light or the second light, of which the degree of light concentration is adjusted;
an eye-tracking module for tracking the eye gaze of the user by collecting the second light reflected from a pupil of the user based on the optical waveguide; and
an image display panel for displaying the virtual image,
wherein the transparent backlight panel, the micro-lens array, and the image display panel are included in a transparent panel of the wearable display that is located directly in front of the pupil of the user.

12. The wearable display of claim 11 , wherein the transparent backlight panel individually controls an intensity of the first light supplied to each of the multiple point lights by adjusting diameters of some of multiple paths corresponding to the optical waveguide.

13. The wearable display of claim 12 , wherein a characteristic of the first light supplied to each of the multiple point lights is individually controlled based on a multiple-layer structure using multiple transparent backlight panels.

14. The wearable display of claim 11 , wherein the micro-lens array is configured with multiple lenses, thicknesses of which are controllable in real time.

15. The wearable display of claim 14 , wherein the multiple lenses are individually controlled in response to a control signal for each of multiple groups generated based on the multiple lenses.

16. The wearable display of claim 11 , wherein the transparent panel of the wearable display further includes an additional micro-lens array, located between the image display panel and the pupil of the user, for calibrating a focus of a composite image to be projected onto the pupil of the user.

17. The wearable display of claim 11 , wherein the transparent panel of the wearable display is in a form of a flat surface or a curved surface.

18. The wearable display of claim 11 , wherein the eye-tracking module collects the reflected second light using an end part of the optical waveguide extended so as to be closer to the pupil of the user.

19. A method for providing a composite image based on optical transparency, comprising:
supplying first light of a first light source for projecting a virtual image and second light of a second light source for tracking an eye gaze of a user to multiple point lights based on an optical waveguide having a bidirectional propagation characteristic, the multiple point lights projecting the first light and the second light;
adjusting a degree of light concentration of any one of the first light and the second light projected by the multiple point lights, using a micro-lens array and outputting the first light or the second light, of which the degree of light concentration is adjusted;
collecting the second light reflected from a pupil of the user based on the optical waveguide, thereby tracking the eye gaze of the user; and
combining an external image with the virtual image based on the tracked eye gaze and providing the combined image to the user,
wherein the micro-lens array is configured with multiple lenses, and the multiple lenses are individually controlled in response to a control signal for each of multip

Assignees

• Electronics & Telecommunications Res Inst
• Electronics And Telecommunications Res Insitute

Inventors

• Yang Ung-Yeon
• Kim Ki-Hong
• Kim Jin-Ho

Classifications

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/0118

  comprising devices for improving the contrast of the display / brillance control visibility · CPC title