Unobtrusive eye mounted display

Patent metadata

Field	Value
Publication number	US-11624938-B2
Application number	US-202117238129-A
Country	US
Kind code	B2
Filing date	Apr 22, 2021
Priority date	Nov 28, 2016
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

An unobtrusive augmented reality (AR) system can be used to assist the wearer in every day interactions by projecting information from the contact lens display onto the retina of the wearer's eye. The unobtrusive augmented reality system includes a necklace and a contact lens display that are unobtrusive to the wearer and the wearer's surrounding environment. The necklace of the unobtrusive augmented reality system generates power and data for the contact lens displays. The necklace and contact lens display include conductive coils inductively coupled by a magnetic field. The inductive coupling allows data and power generated by the necklace to be transferred to the contact lens display. A projector in the contact lens display projects images generated from the data onto the retina of the wearers eye.

First claim

What is claimed is:

1. An augmented reality system comprising:
a contact lens display capable of projecting images onto a user's retina;
an audio input configured to receive audio that contains speech from an environment surrounding the contact lens display; and
a processor coupled to the audio input, the processor configured to:
receive the audio from the audio input;
determine a source of the audio within the environment based on the received audio;
generate an identifier of the audio source within the environment in a format suitable for transmission to the contact lens display, wherein the contact lens display projects the identifier of the audio source in the environment onto the user's retina when the determined audio source is within a field of view of the user;
receive additional audio from the audio input;
determine an additional audio source of the additional audio based on the received additional audio; and
generate an additional identifier of the additional audio source in a format suitable for transmission to the contact lens display, wherein the contact lens display projects the additional identifier onto the user's retina.

2. The augmented reality system of claim 1 , wherein the processor is further configured to compare the received audio to a database of previously recorded audio and to determine the audio source based on the comparison.

3. The augmented reality system of claim 2 , wherein the received audio is a person's voice sample and the database of comprises a plurality of previously recorded voice samples such that the processor compares the person's voice sample to previously recorded voice samples in the database.

4. The augmented reality system of claim 3 , wherein the generated identifier is a name associated with the person's voice sample.

5. The augmented reality system of claim 1 , wherein the audio source is visible within the user's field of view, and the contact lens display projects the identifier onto the user's retina so as to appear within the user's field of view in close proximity to the audio source.

6. The augmented reality system of claim 5 , wherein the audio source is a person and the identifier is a name of the person.

7. The augmented reality system of claim 1 , wherein the audio source and the additional audio source are visible within the user's field of view, and the contact lens display projects the identifier and the additional identifier onto the user's retina so as to appear within the user's field of view in close proximity to the audio source and the additional audio source, respectively.

8. The augmented reality system of claim 7 , wherein the audio source is a person and the identifier is a name of the person, and wherein the additional audio is an additional person and the additional identifier is a name of the additional person.

9. The augmented reality system of claim 1 , wherein the contact lens display comprises a scleral contact lens that contains a femtoprojector.

10. The augmented reality system of claim 9 , wherein the scleral contact lens comprises an antenna for receiving the identifier, the antenna embedded between a front surface and a back surface of the scleral contact lens.

11. The augmented reality system of claim 1 , further comprising a mobile electronic device, wherein the mobile electronic device comprises a microphone and the processor, the microphone providing the audio to the audio input.

12. The augmented reality system of claim 1 , further comprising:
a visual input configured to received images that contain manual communication; and
wherein the processor is coupled to the visual input and is further configured to:
receive the images from the visual input;
recognize manual communication in the images; and
convert the images to text representing the manual communication in a format suitable for transmission to the contact lens display, wherein the contact lens display projects the text representing the manual communication onto the user's retina.

13. The augmented reality system of claim 12 , wherein the manual communication is a sign from American Sign Language.

14. The augmented reality system of claim 12 , wherein the processor is further configured to:
input the visual input into a machine learning model configured to recognize manual communication; and
receive an output from the machine learning model including data textually representing the manual communication in the visual input.

15. The augmented reality system of claim 12 , wherein the contact lens display comprises a scleral contact lens that contains a femtoprojector.

16. The augmented reality system of claim 15 , and the scleral contact lens comprises an antenna for receiving the text, the antenna embedded between a front surface and a back surface of the scleral contact lens.

17. The augmented reality system of claim 12 , further comprising a mobile electronic device, wherein the mobile electronic device comprises a camera and the processor, the camera providing the visual input.

Assignees

• Tectus Corp

Inventors

• Miller Gregory David
• Lemoff Brian Elliot
• Tuan Kuang-Mon Ashley
• Kniess Herbert John
• Opris Ion
• Wiemer Michael West
• Perkins Drew Daniel

Classifications

• H04B5/266

  One coil at each side, e.g. with primary and secondary coils · CPC title

• A44C15/005

  Necklaces (ornamental chains A44C11/00) · CPC title

• G02B27/01

  Head-up displays · CPC title

• G02B2027/0152

  involving arrangement aiming to get lighter or better balanced devices · CPC title

• G02B27/017

  Head mounted · CPC title