Varying display content based on viewpoint

Patent metadata

Field	Value
Publication number	US-10652522-B2
Application number	US-201816154506-A
Country	US
Kind code	B2
Filing date	Oct 8, 2018
Priority date	May 22, 2014
Publication date	May 12, 2020
Grant date	May 12, 2020

Abstract

A method for creating multiple viewpoint images for an image frame. The method includes receiving by a processing element a left eye image and a right eye image, wherein the left eye image and right eye image comprise a stereoscopic image pair. Once the images are received, the method includes determining by the processing element a first viewing location corresponding to the left eye image and a second viewing location corresponding to the right eye image and determining by the processing element a plurality of new viewpoint locations using the first viewing location and the second viewpoint location.

First claim

What is claimed is:

1. A method of displaying content on a two-dimensional display for a three-dimensional effect comprising:
displaying on the two-dimensional display a first image having a first viewpoint of a first frame of the content, wherein the first image includes a portion of the first frame and the first frame is predetermined;
detecting by a sensor a user input;
analyzing by a processing element the user input;
determining, by the processing element, an adjustment to the first viewpoint based on the user input to provide an external viewpoint location that falls outside the first viewpoint of the first image;
determining, by the processing element, a second image including edge content based on the first image and generated from the first frame, wherein the edge content includes additional information and is based on the exterior viewpoint location included in the first frame and not visible in the first image; and
selectively displaying by the two-dimensional display the second image having the second viewpoint and the additional information corresponding to the edge content.

2. The method of claim 1 , wherein the user input is at least one of a head movement or an eye movement.

3. The method of claim 1 , wherein the sensor is at least one of a camera, a capacitive touch sensor, an accelerometer, or a gyroscope.

4. The method of claim 1 , wherein the sensor and the two-dimensional display are incorporated into an integrated device.

5. The method of claim 1 , wherein when the user input is a second value selectively displaying by the two-dimensional display a third image having a third viewpoint corresponding to a second frame of the content.

6. A computing device comprising:
a screen for displaying a visual output;
at least one sensor for detecting a first user input to the computing device; and
a processing element in communication with the screen and the at least one sensor; wherein
in response to the first user input;
the screen displays a first viewpoint image of a predetermined frame of content;
the processing element determines an adjustment to a viewpoint of the first viewpoint image based on the user input to generate an exterior viewpoint location that is outside of the viewpoint of the first image;
the processing element determines a second viewpoint image corresponding to the exterior viewpoint location generated from the frame of content including peripheral content based on the first viewpoint image, wherein the peripheral content includes an edge object included in the first frame and not visible in the first viewpoint image; and

the screen displays a second viewpoint image having the second viewpoint and including the edge object corresponding to the peripheral content.

7. The computing device of claim 6 , wherein in response to a second user input the processing element selectively transmits a third viewpoint image, wherein the third viewpoint image corresponds to an image of a second image frame at the second viewpoint.

8. The computing device of claim 6 , wherein
after display of the first viewpoint image the processing element transmits a sequence of viewpoint images to the screen; and
the screen sequentially displays the sequence of viewpoint images; wherein
the sequence of viewpoint image is selected based on a progression of viewpoint locations.

9. The computing device of claim 6 , wherein the at least one sensor is at least one of an accelerometer, a gyroscope, a camera, or a touch sensor.

10. The computing device of claim 6 , wherein the screen and the processing element are incorporated into an integrated computing device.

11. A method of displaying content on a two-dimensional display for a three-dimensional effect comprising:
receiving by a processing element a left eye image and a right eye image, wherein the left eye image and right eye image comprise a stereoscopic image pair;
detecting by a sensor a first user input corresponding to a first left viewing location corresponding to the left eye image and a first right viewing location corresponding to the right eye image;
determining by the processing element a plurality of exterior viewpoint locations outside of a range between the first left viewing location and the first right viewing location:
generating a plurality of exterior viewpoint images based on the exterior viewpoint locations and both the left eye image and the right image at the exterior viewing locations:
displaying on the two-dimensional display a first image having a first viewpoint of a first frame of the content, wherein the first image includes a portion of the first frame and the first frame is predetermined;
detecting by the sensor a second user input corresponding to a second left viewing location corresponding to the left eye image and a second right viewing location corresponding to the right eye image;
determining, by the processing element, an adjustment to the first left viewing location and first right viewing location based on the second user input;
determining, by the processing element, a second viewpoint location corresponding to one of the plurality of exterior viewpoint locations corresponding to the adjustment to the first left viewing location and the first right viewing location;
displaying on the two-dimensional display a second image corresponding to the second viewpoint location, corresponding to one of the plurality of exterior viewpoint images.

12. The method of claim 11 , further comprising;
including edge content based on the first image and generated from the first frame, wherein the edge content includes additional information included in the first frame and not visible in the first image; and
selectively displaying by the two-dimensional display the second image having the second viewpoint location and the additional information corresponding to the edge content.

13. The method of claim 11 , wherein the user input is at least one of a head movement or an eye movement.

14. The method of claim 11 , wherein the sensor and the two-dimensional display are incorporated into an integrated device.

15. The method of claim 11 , wherein when the user input is a third value selectively displaying by the two-dimensional display a third image corresponding to one of the plurality of exterior viewpoint images having a third viewpoint corresponding thereto.

Assignees

• Disney Entpr Inc

Inventors

• Siegel Lewis Nathaniel
• Bloch Brandon
• Neuman Robert M
• Whited Brian
• Bossert David Anthony

Classifications

• H04N13/261 Primary

  with monoscopic-to-stereoscopic image conversion · CPC title

• H04N13/128

  Adjusting depth or disparity · CPC title

• H04N13/111

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N13/366

  using viewer tracking · CPC title