Enhanced visual perception through distance-based ocular projection

Patent metadata

Field	Value
Publication number	US-10451876-B2
Application number	US-201615065796-A
Country	US
Kind code	B2
Filing date	Mar 9, 2016
Priority date	Aug 3, 2015
Publication date	Oct 22, 2019
Grant date	Oct 22, 2019

Abstract

A display device includes a two-dimensional array of tiles. Each tile includes a two-dimensional array of pixels and an electro-optic element of a two-dimensional array of electro-optic elements. The device includes one or more processors configured to: obtain an image of an object; activate at least a subset of the two-dimensional array of tiles for outputting a collective pattern of light that includes at least a portion of the image of the object; and activate at least a subset of the two-dimensional array of electro-optic elements for projecting the collective pattern of light. At least the subset of the two-dimensional array of electro-optic elements is configured to have a focal length, that is selected based on proximity of the object in a distance model, for projecting the collective pattern of light.

First claim

What is claimed is:

1. A display device, comprising:
a two-dimensional array of tiles, each tile comprising:
a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and
an electro-optic element, of a two-dimensional array of electro-optic elements, configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user, wherein each electro-optic element of the two-dimensional array of electro-optic elements is individually controllable to have a respective focal length; and

one or more processors coupled with the two-dimensional array of tiles and configured to:
obtain an image of a first object;
activate a first subset of the two-dimensional array of tiles for outputting, from the first subset of the two-dimensional array of tiles, a first collective pattern of light that includes at least a portion of the image of the first object, the first subset of the two-dimensional array of tiles including two or more contiguous tiles, a first tile of the two or more contiguous tiles outputting a first portion of the image and a second tile, adjacent to the first tile, of the two or more contiguous tiles outputting a second portion of the image that does not overlap with the first portion of the image;
activate, concurrently with activation of the first subset of the two-dimensional array of tiles for outputting the first collective pattern of light from the first subset of the two-dimensional array of tiles, a second subset of the two-dimensional array of tiles for outputting, from at least the second subset of the two-dimensional array of tiles, a second collective pattern of light that includes at least a portion of an image of a second object so that the first collective pattern of light and the second collective pattern of light are concurrently projected;
activate a first subset of the two-dimensional array of electro-optic elements for projecting the first collective pattern of light, wherein the first subset of the two-dimensional array of electro-optic elements is configured to have a first focal length, that is selected based on proximity of the first object in a distance model, for projecting the first collective pattern of light; and
activate, concurrently with activation of the first subset of the two-dimensional array of electro-optic elements for projecting the first collective pattern of light so that the first subset of the two-dimensional array of electro-optic elements is configured to have the first focal length, a second subset of the two-dimensional array of electro-optic elements for projecting the second collective pattern of light, wherein the second subset of the two-dimensional array of electro-optic elements is configured to have a second focal length, that is selected based on proximity of the second object in the distance model, for projecting the second collective pattern of light, and the second focal length is distinct from the first focal length, wherein

for any pixel of the activated subset of the two-dimensional array of tiles that outputs light, at least a portion of the light from the pixel is directed to the pupil of the eye of the user.

2. The display device of claim 1 , wherein the one or more processors are configured to:
subsequent to projecting the first collective pattern of light while the first subset of the two-dimensional array of electro-optic elements is configured to have the first focal length:
determine that the proximity of the first object has changed in the distance model;
activate a third subset of the two-dimensional array of tiles for outputting, from at least the third subset of the two-dimensional array of tiles, a third collective pattern of light that includes at least a portion of an updated image of the first object; and
activate a third subset of the two-dimensional array of electro-optic elements for projecting the third collective pattern of light, wherein the third subset of the two-dimensional array of electro-optic elements is configured to have a third focal length, that is selected based on the changed proximity of the first object in the distance model, for projecting the third collective pattern of light.

3. The display device of claim 1 , wherein the one or more processors are configured to:
determine a position of the pupil of the eye; and
obtain the image of the first object based on the position of the pupil of the eye.

4. The display device of claim 3 , including:
an array of sensors for determining the position of the pupil of the eye.

5. The display device of claim 1 , wherein:
the electro-optic element has a first focal length while the first set of voltages is applied to the one or more electrodes on the first substrate and the plurality of electrodes on the second substrate;
the one or more electrodes are configured to receive one or more voltages of a second set of voltages that is distinct from the first set of voltages; and
the first subset of electrodes are configured to receive a first voltage of the second set of voltages and the second subset of electrodes configured to receive a second voltage, of the second set of voltages, that is distinct from the first voltage of the second set of voltages so that the electro-optic element has a second focal length that is distinct from the first focal length while the second set of voltages is applied to the one or more electrodes on the first substrate and the plurality of electrodes on the second substrate.

6. The display device of claim 1 , wherein the display device is not a light field display device.

7. A method performed with a display device including a two-dimensional array of tiles and one or more processors coupled with the two-dimensional array of tiles, each tile including a two-dimensional array of pixels and an electro-optic element, of a two-dimensional array of electro-optic elements, the method comprising:
obtaining an image of a first object;
activating a first subset of the two-dimensional array of tiles for outputting, from the first subset of the two-dimensional array of tiles, a first collective pattern of light that includes at least a portion of the image of the first object, the first subset of the two-dimensional array of tiles including two or more contiguous tiles, a first tile of the two or more contiguous tiles outputting a first portion of the image and a second tile, adjacent to the first tile, of the two or more contiguous tiles outputting a second portion of the image that does not overlap with the first portion of the image, wherein each pixel of the two-dimensional array of pixels is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light and the electro-optic element of the two-dimensional array of electro-optic elements is configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user, and each electro-optic element of the two-dimensional array of electro-optic elements is individually controllable to have a respective focal length;
activating, concurrently with activation of the first subset of the two-dimensional array of tiles for outputting the first collective pattern of light from the first subset of the two-dimensional array of tiles, a second subset of the two-dimensional array of tiles for outputting, from at least the second subset of the two-dimensional array of tiles, a second collective pattern of light that includes at least a portion of an image of a second object so that the first collective pattern of light and the second collective pattern of light are concurrently

Assignees

• Facebook Tech Llc

Inventors

• Jepsen Mary Lou

Classifications

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2320/028

  by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction · CPC title

• G02F1/29

  for the control of the position or the direction of light beams, i.e. deflection · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title