Wearable image manipulation and control system with correction for vision defects and augmentation of vision and sensing

Patent metadata

Field	Value
Publication number	US-2018249151-A1
Application number	US-201815962661-A
Country	US
Kind code	A1
Filing date	Apr 25, 2018
Priority date	Mar 17, 2015
Publication date	Aug 30, 2018
Grant date	—

Abstract

A wearable image manipulation system comprising a camera input system, an image projection system, where the image projection system is capable of being worn by a user, and a processor in communication with the camera input system and the image projection system such that the processor is capable of receiving an image from the camera input system, modifying the image to produce a modified image, and displaying the modified image on the image projection system. The camera input system may comprise a contact lens with a camera mounted thereon. Additionally or alternately, the system may be capable of tracking a user's eye movement to accurately capture where the user is looking with the camera input system.

First claim

What is claimed is:

1 . A wearable image manipulation system comprising:
a camera input system; an image projection system, where the image projection system is capable of being worn by a user; and a processor in communication with the camera input system and the image projection system such that the processor is capable of receiving an image from the camera input system, modifying the image to produce a modified image, and displaying the modified image on the image projection system.

2 . The system of claim 1 where the camera input system comprises a contact lens with a camera mounted thereon or at least partially embedded therein.

3 . The system of claim 1 further comprising an eye tracking camera, where the eye tracking camera is capable of tracking movement of a user's eye and the system is capable of adjusting the camera input system such that the image received by the processor from the camera input system is based on the user's eye movement.

4 . The system of claim 3 where the eye tracking camera is positioned such that it is pointed toward an eye of the user during use.

5 . The system of claim 3 further comprising software utilized by the processor to adjust the displayed modified image based on eye tracking data from the eye tracking camera.

6 . The system of claim 3 where modifying the image comprises correcting for epipolar geometry and line of sight.

7 . The system of claim 1 further comprising headgear, where the headgear houses the image projection system.

8 . The system of claim 7 where the headgear houses one or more of the following sensors: motion sensors, degrees of freedom sensors, gesture recognition sensors, fiducial marker sensors, accelerometer sensors, infrared sensors, motion sensors, alert sensors, gyroscope technology and related sensors, positional tracking sensors, sound sensors, optical sensors, magnetic sensors, acoustic sensors, and/or inertial sensors.

9 . The system of claim 7 where the headgear houses one or more of the following subsystems: head and eye tracking; hand and arm tracking; body tracking; and/or environment mapping interfaces.

10 . The system of claim 7 where the headgear houses the processor.

11 . The system of claim 7 where the headgear houses the camera input system.

12 . The system of claim 7 where the headgear is capable of being worn on the head of the user and positioned over the user's eyes and nose like glasses.

13 . The system of claim 7 where the headgear is a helmet and the display is a face shield.

14 . The system of claim 1 where the camera input system comprises a video camera, a still camera, a night-vision camera, an infrared camera, a thermal imaging camera, a 3D camera, or any combination thereof.

15 . The system of claim 1 where the system is capable of recording images from the camera input system.

16 . The system of claim 1 where the image projection system is capable of displaying at least part of the image and at least part of the modified image simultaneously.

17 . The system of claim 1 where modifying the image comprises correcting for eye defects.

Assignees

• Raytrx Llc

Inventors

• Freeman Michael Hayes
• Freeman Richard C
• Freeman Mitchael C
• Boss Chad
• Boss Jordan

Classifications

• A61B3/005

  Constructional features of the display · CPC title

• G06K9/00671

  Physics · mapped topic

• A61B5/1114

  Tracking parts of the body · CPC title

• A61B5/1123

  Discriminating type of movement, e.g. walking or running (A61B5/1116, A61B5/112 take precedence) · CPC title

• H04N13/332 Primary

  Displays for viewing with the aid of special glasses or head-mounted displays [HMD] · CPC title