Headset display control based upon a user's pupil state

Patent metadata

Field	Value
Publication number	US-10810773-B2
Application number	US-201715623002-A
Country	US
Kind code	B2
Filing date	Jun 14, 2017
Priority date	Jun 14, 2017
Publication date	Oct 20, 2020
Grant date	Oct 20, 2020

Abstract

Systems and methods for display control based on pupil size in virtual, augmented, and mixed reality (xR) applications. In some embodiments, a method may include: identifying, via a camera mounted to a body a headset facing an eye of a user wearing the headset, a pupil state of the user; communicating an indication of the pupil state to an Information Handling System (IHS) coupled to the headset, wherein the IHS is configured to select a setting based upon the pupil state and transmit an indication of the setting to the headset; and applying the setting, via a controller of the headset, to at least one of: (a) a display mounted on the body of the headset, or (b) an image shown to the user via the display.

First claim

The invention claimed is:

1. A headset, comprising:
a body;
a display coupled to the body;
a camera coupled to the body;
a controller coupled to the display; and
a memory coupled to the controller, the memory comprising program instructions stored thereon that, upon execution, cause the controller to:
identify, via the camera, a rate of change of pupil size of a user wearing the headset;
select a setting based upon the rate of change of pupil size, wherein the setting comprises a priority of an image relative to other images in a given frame, wherein the image has a higher priority than at least one of the other images, and wherein the program instructions, upon execution, further cause the controller to:
abstain from showing the at least one of the other images to the user via the display; and

apply the setting to the image shown to the user via the display, wherein:
in response to the rate of change of pupil size being slower than a rate detected during a prior training operation where the image was shown, the setting is configured to direct the user's attention toward the image and away from the real world outside of the headset; and
in response to the rate of change of pupil size being faster than a rate detected during the prior training operation where the image was shown, the setting is configured to direct the user's attention away from the image and toward the real world outside of the headset.

2. The headset of claim 1 , wherein the display includes at least one of: an optical projector, a monitor, or a handheld device.

3. The headset of claim 1 , wherein the camera is directed toward an eye of the user, and wherein the camera includes at least one of: an infrared camera, or a video camera.

4. The headset of claim 1 , wherein the setting comprises at least one of: a size of the image, a position of the image, or a length of time during which the image is shown.

5. The headset of claim 1 , wherein the headset further comprises an Ambient Light Sensor (ALS), and wherein the program instructions, upon execution, further cause the controller to:
after initially showing the image to the user, abstain from continuing to perform at least one of: (a) the identify operation, (b) the select operation, or (c) the apply operation with respect to at least one of: the image, or a subsequent image, in response to the ALS indicating that the light condition has not changed by a threshold amount.

6. The headset of claim 1 , wherein the program instructions, upon execution, further cause the controller to communicate the setting to an Information Handling System (IHS) coupled to the headset, and wherein the IHS is configured to apply the setting to another display distinct from the headset.

7. The headset of claim 1 , wherein the setting comprises a brightness of the display, and wherein: (a) the pupil size is below a first threshold value, and, to apply the setting, the program instructions, upon execution, further cause the controller to increase the brightness of the display; or (b) the pupil size is above a second threshold value, and, to apply the setting, the program instructions, upon execution, further cause the controller to decrease the brightness of the display.

8. The headset of claim 1 , wherein the setting comprises a color scheme, wherein the color scheme is selected from the group consisting of: grayscale or color, and wherein, to apply the setting, the program instructions, upon execution, further cause the controller to switch from a first color scheme to a second color scheme, the second color scheme designed to: (a) increase awareness of the user; or (b) reduce discomfort of the user.

9. A method, comprising:
identifying, via a camera coupled to a headset, a rate of change of pupil size of a user wearing the headset;
selecting a setting based upon the rate of change of pupil size, wherein the setting comprises a priority of an image relative to other images in a given frame, wherein the image has a higher priority than at least one of the other images, and wherein the method, upon execution, further causes to:
abstain from showing the at least one of the other images to the user via the display; and

applying the setting to the image shown to the user via a display coupled to the headset, wherein:
in response to the rate of change of pupil size being slower than a rate detected during a prior training operation where the image was shown, the setting is configured to direct the user's attention toward the image and away from the real world outside of the headset, and
in response to the rate of change of pupil size being faster than a rate detected during the prior training operation where the image was shown, the setting is configured to direct the user's attention away from the image and toward the real world outside of the headset.

10. The method of claim 9 , wherein the setting comprises at least one of: a size of the image, a position of the image, or a length of time during which the image is shown.

11. The method of claim 9 , further comprising:
after initially showing the image to the user, abstaining from continuing to perform at least one of: (a) the identifying operation, (b) the selecting operation, or (c) the applying operation with respect to at least one of: the image, or a subsequent image, in response to an Ambient Light Sensor (ALS) coupled to the headset indicating that the light condition has not changed by a threshold amount.

12. The method of claim 9 , wherein the setting comprises a brightness of the display, and wherein: (a) the pupil size is below a first threshold value, and wherein applying the setting further comprises increasing the brightness of the display; or (b) the pupil size is above a second threshold value, and wherein applying the setting further comprises decreasing the brightness of the display.

13. The method of claim 9 , wherein the setting comprises a color scheme, wherein the color scheme is selected from the group consisting of: grayscale or color, and wherein applying the setting further comprises switching from a first color scheme to a second color scheme, the second color scheme designed to: (a) increase awareness of the user; or (b) reduce discomfort of the user.

14. A memory storage device having program instructions stored thereon that, upon execution by one or more processors of a headset, cause the headset to:
identify, via a camera coupled to a headset, a rate of change of pupil size of a user wearing the headset;
select a setting based upon the rate of change of pupil size, wherein the setting comprises a priority of an image relative to other images in a given frame, wherein the image has a higher priority than at least one of the other images, and wherein the program instructions, upon execution, further cause the headset to:
abstain from showing the at least one of the other images to the user via the display; and

apply the setting to the image shown to the user via a display coupled to the headset, wherein:
in response to the rate of change of pupil size being slower than a rate detected during a prior training operation where the image was shown, the setting is configured to direct the user's attention toward the image and away from the real world outside of the headset, and
in response to the rate of change of pupil size being faster than a rate detected during the prior training operation where the image was shown, the setting is configured to direct the user's attention away from the image and toward the real world outside of the headset.

15. The memory storage device of claim 14 , wherein the setting comprises at l

Assignees

• Dell Products Lp

Inventors

• Yildiz Yagiz Can
• Bryan Rex W

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06V20/64 Primary

  Three-dimensional [3D] objects · CPC title

• G06V40/193

  Preprocessing; Feature extraction · CPC title

• G06V40/19

  Sensors therefor · CPC title

• G02B2027/0118

  comprising devices for improving the contrast of the display / brillance control visibility · CPC title