Display systems and methods for clipping content to increase viewing comfort

Patent metadata

Field	Value
Publication number	US-12205220-B2
Application number	US-202218077677-A
Country	US
Kind code	B2
Filing date	Dec 8, 2022
Priority date	Mar 14, 2018
Publication date	Jan 21, 2025
Grant date	Jan 21, 2025

Abstract

Augmented and virtual reality display systems increase viewer comfort by reducing viewer exposure to virtual content that causes undesirable accommodation-vergence mismatches (AVM). The display systems limit displaying content that exceeds an accommodation-vergence mismatch threshold, which may define a volume around the viewer. The volume may be subdivided into two or more zones, including an innermost loss-of-fusion zone (LoF) in which no content is displayed, and one or more outer AVM zones in which the displaying of content may be stopped, or clipped, under certain conditions. For example, content may be clipped if the viewer is verging within an AVM zone and if the content is displayed within the AVM zone for more than a threshold duration. A further possible condition for clipping content is that the user is verging on that content. In addition, the boundaries of the AVM zone and/or the acceptable amount of time that the content is displayed may vary depending upon the type of content being displayed, e.g., whether the content is user-locked content or in-world content.

First claim

What is claimed is:

1. A head-mounted display system for displaying a virtual object, the display system comprising:
one or more processors; and
one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
determining whether a virtual object is to be displayed at a location having an accommodation-vergence mismatch exceeding a threshold value;
determining whether an eye of the user is closed;
refraining from displaying the virtual object after determining that an eye of the user is not closed and that the virtual object is to be displayed at a location having the accommodation-vergence mismatch exceeding the threshold value; and
displaying the virtual object after determining that the eye of the user is closed and that the virtual object is to be displayed at a location having the accommodation-vergence mismatch exceeding the threshold value.

2. The display system of claim 1 , wherein displaying the virtual object after determining that the eye of the user is closed comprises displaying the virtual object to an open eye of the user after determining that an other eye of the user is closed.

3. The display system of claim 1 , wherein displaying the virtual object after determining that the eye of the user is closed comprises displaying the virtual object within a loss-of fusion zone of the user.

4. The display system of claim 1 , comprising an eyepiece configured to output light with variable amounts of wavefront divergence.

5. The display system of claim 4 , wherein the eyepiece comprises a stack of waveguides, wherein at least one of the waveguides of the stack of waveguides is configured to output light with a different amount of wavefront divergence than an other waveguide of the stack of the waveguides.

6. The display system of claim 1 , wherein the operations further comprise: identifying a type of content corresponding to the virtual object; and setting the threshold value based at least in part on the identified type of content.

7. The display system of claim 6 , wherein the type of content comprises user-locked content or in-world content.

8. A method for displaying a virtual object by a head-mounted display system, the method comprising:
determining whether a virtual object is to be displayed at a location having an accommodation-vergence mismatch exceeding a threshold value;
determining whether an eye of the user is closed;
refraining from displaying the virtual object after determining that an eye of the user is not closed and that the virtual object is to be displayed at a location having the accommodation-vergence mismatch exceeding the threshold value; and
displaying the virtual object after determining that the eye of the user is closed and that the virtual object is to be displayed at a location having the accommodation-vergence mismatch exceeding the threshold value.

9. The method of claim 8 , wherein displaying the virtual object after determining that the eye of the user is closed comprises displaying the virtual object to an open eye of the user after determining that an other eye of the user is closed.

10. The method of claim 8 , wherein displaying the virtual object after determining that the eye of the user is closed comprises displaying the virtual object within a loss-of-fusion zone of the user.

11. The method of claim 8 , wherein the display system comprises an eyepiece configured to output light with variable amounts of wavefront divergence.

12. The method of claim 11 , wherein the eyepiece comprising a stack of waveguides, wherein at least one of the waveguides of the stack of waveguides is configured to output light with a different amount of wavefront divergence than an other waveguide of the stack of the waveguides.

13. The method of claim 11 , wherein the operations further comprise:
identifying a type of content corresponding to the virtual object; and
setting the threshold value based at least in part on the identified type of content.

14. The method of claim 8 , wherein the type of content comprises user-locked content or in-world content.

15. A display system for displaying a virtual object in a binocular field of view (FOV) of a user, the display system comprising:
one or more processors; and
one or more computer storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
determining whether the virtual object has crossed a boundary between different zones of a plurality of zones corresponding to different volumes of space in the FOV, wherein the determining whether the virtual object has crossed the boundary between the different zones includes determining whether the virtual object has crossed the boundary between an accommodation-vergence mismatch discomfort zone and an accommodation-vergence comfort zone; and
in response to determining that the virtual object has crossed the boundary between the different zones, switching between (i) a binocular presentation mode in which the virtual object is displayed to both eyes of the user, and (ii) a monocular presentation mode in which the virtual object is only displayed to one eye of the user.

16. The display system of claim 15 , wherein the operations further comprise:
selecting, from among both eyes of the user, a particular eye of the user, wherein the virtual object is only displayed to the particular eye of the user in the monocular presentation mode.

17. The display system of claim 16 , wherein the operations further comprise:
determining which eye of the user is the user's dominant eye, wherein selecting the particular eye of the user comprises the dominant eye to display the virtual object.

18. The display system of claim 16 , wherein the operations further comprise:
determining whether the virtual object is located within a left portion of the user's binocular FOV or a right portion of the user's binocular FOV,
wherein selecting, from among both eyes of the user, the particular eye of the user comprises: selecting, from among both eyes of the user, the particular eye of the user based at least in part on determining whether the virtual object is located within the left portion of the user's binocular FOV or the right portion of the user's binocular FOV.

19. The display system of claim 15 , wherein switching between (i) the binocular presentation mode in which the virtual object is displayed to both eyes of the user, and (ii) the monocular presentation mode in which the virtual object is only displayed to one eye of the user comprises:
switching between (i) a binocular presentation mode in which the virtual object is displayed at a first level of brightness to each eye of the user, and (ii) a monocular presentation mode in which the virtual object is only displayed at a second level of brightness to one eye of the user, the second level of brightness being greater than the first level of brightness in which the other virtual object is only displayed to one eye of the user.

20. The display system of claim 15 , wherein the operations further comprise:
determining whether another virtual object has crossed the boundary between different zones of the binocular FOV of the user; and
in response to determining that the other virtual object has crossed the boundary between different zones of the binocular FOV of the user and independent from determining that the virtual object has crossed the boundary between

Assignees

• Magic Leap Inc

Inventors

• Schwab Brian David
• Hand Randall E
• Maskamp Björn Nicolaas Servatius

Classifications

• G06T15/20

  Perspective computation · CPC title

• H04N13/122

  Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence) · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/0081

  with means for altering, e.g. enlarging, the entrance or exit pupil · CPC title