Head-mountable display system

Patent metadata

Field	Value
Publication number	US-10187633-B2
Application number	US-201615014170-A
Country	US
Kind code	B2
Filing date	Feb 3, 2016
Priority date	Feb 6, 2015
Publication date	Jan 22, 2019
Grant date	Jan 22, 2019

Abstract

A method of operation of a head mountable display (HMD) system, in which stereoscopic images are displayed with respect to a virtual display screen (VDS) position, is provided. The method includes setting a VDS position for a stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display. The method also includes generating the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

First claim

We claim:

1. A method of operation of a head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the method comprising the steps of:
setting, by one or more processors including at least one of an image processor and a display controller, a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer's head; and
generating, by one or more processors including at least the display controller, the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

2. A method according to claim 1 , in which the setting step comprises:
setting the VDS position for the stereoscopic image for display to be substantially equal to a depth represented by the depth parameter of the region of interest (ROI) in respect of the stereoscopic image for display.

3. A method according to claim 1 , in which the generating step comprises:
rendering the stereoscopic image for display having the image parallax appropriate to the VDS position set by the setting step.

4. A method according to claim 1 , in which the generating step comprises:
image-shifting portions of a first stereoscopic image to generate the stereoscopic image for display.

5. A method according to claim 1 , further comprising the step of:
detecting image content of the stereoscopic image for display so as to detect the ROI in respect of the stereoscopic image for display.

6. A method according to claim 1 , further comprising the step of:
detecting a viewer gaze direction in respect of a preceding displayed stereoscopic image so as to detect the ROI in respect of the stereoscopic image for display.

7. A method according to claim 1 , further comprising the step of:
detecting the depth parameter from metadata accompanying the stereoscopic image for display.

8. A method according to claim 1 , in which the VDS is non-planar.

9. A method according to claim 8 , in which the VDS is curved so as to at least partially surround the viewer.

10. A method according to claim 8 , in which the setting step comprises setting a local radial depth for a portion of the VDS according to a depth parameter of a portion of the stereoscopic image for display by the portion of the VDS.

11. A method according to claim 10 , in which the setting step comprises setting two or more different local radial depths for respective portions of the VDS according to respective depth parameters of respective portions of the stereoscopic image for display by the corresponding portion of the VDS.

12. A non-transitory machine-readable storage medium that stores computer instructions thereon, the instructions, when executed by a computer including one or more processors including at least one of an image processor and a display controller, cause the computer to carry out a method of operation of a head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the method comprising the steps of:
setting, by at least one of the image processor and the display controller a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer's head; and
generating, by one or more processors including at least the display controller, the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.

13. A head mountable display (HMD) system in which a stereoscopic image formed by a first image and a second image is displayed with respect to a virtual display screen (VDS) position for the stereoscopic image, the system comprising an image processor and a display controller:
at least one of the image processor and the display controller being configured to set a VDS position for a panoramic stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display, in which the VDS position is determined based on a displacement between a position of the first image and a position of the second image, and a radial distance of the VDS from the head of a viewer of the HMD varies according to an orientation of the viewer's head; and
at least the display controller being configured to generate the stereoscopic image for display having an image parallax appropriate to the VDS position set by the image processor.

14. An HMD system according to claim 13 , further comprising a display arrangement operatively coupled to the image processor, the display arrangement being configured to display the generated stereoscopic image to a wearer of the HMD.

Assignees

• Sony Interactive Entertainment Europe Ltd

Inventors

• Bickerstaff Ian Henry
• Raghoebardajal Sharwin Winesh
• Benson Simon Mark

Classifications

• G06F3/012

  Head tracking input arrangements · CPC title

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• H04N13/239

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title