Electronic devices with dynamic brightness ranges for passthrough display content

Patent metadata

Field	Value
Publication number	US-12067909-B2
Application number	US-202318490679-A
Country	US
Kind code	B2
Filing date	Oct 19, 2023
Priority date	Dec 16, 2022
Publication date	Aug 20, 2024
Grant date	Aug 20, 2024

Abstract

A head-mounted device may include a camera that captures a live video feed of an environment. A display in the head-mounted device may display passthrough display content that includes the live video feed. Control circuitry may dynamically adjust a maximum allowable brightness for the passthrough display content during operation of the head-mounted device. Upon an initial donning of the head-mounted device, the passthrough display content may be permitted to use most or all of the achievable brightness range of the display. After a given time period, the user may be adapted to the brightness range of the display and the maximum allowable brightness for the passthrough display content may be reduced to allow additional headroom for rendered display content. The control circuitry may continue to adjust tone mappings for passthrough display content and rendered display content based on whether the display content favors real-world content or virtual content.

First claim

What is claimed is:

1. A head-mounted device, comprising:
a camera configured to capture a live video feed of an environment;
a display configured to display rendered display content and passthrough display content, wherein the passthrough display content includes the live video feed;
a lens through which the rendered display content and passthrough display content are viewable from an eye box; and
control circuitry configured to:
dynamically adjust an available brightness range for the passthrough display content and an amount of headroom for the rendered display content during operation of the head-mounted device; and
determine a first tone mapping for the passthrough display content and a second tone mapping for the rendered display content based on the available brightness range for the passthrough display content and the amount of headroom for the rendered display content.

2. The head-mounted device defined in claim 1 wherein the control circuitry is configured to adjust the available brightness range for the passthrough display content and the amount of headroom for the rendered display content based on which application is running on the head-mounted device.

3. The head-mounted device defined in claim 1 wherein the control circuitry is configured to adjust the available brightness range for the passthrough display content and the amount of headroom for the rendered display content based on whether the head-mounted device has been worn for a given amount of time.

4. The head-mounted device defined in claim 1 wherein the display is operable in a first display mode that favors real-world content and a second display mode that favors virtual content, and wherein the control circuitry is configured to adjust the available brightness range for the passthrough display content and the amount of headroom for the rendered display content based on whether the display is operating in the first display mode or the second display mode.

5. The head-mounted device defined in claim 4 wherein the available brightness range for the passthrough display content in the first display mode is greater than the available brightness range for the passthrough display content in the second display mode.

6. The head-mounted device defined in claim 4 wherein the amount of headroom for the rendered display content in the first display mode is less than the amount of headroom for the rendered display content in the second display mode.

7. The head-mounted device defined in claim 4 wherein the control circuitry is configured to determine a transition time for a transition between the first and second display modes.

8. The head-mounted device defined in claim 7 wherein the transition time is determined based on whether the transition between the first and second display modes is triggered by a user-initiated action or a device-initiated action.

9. The head-mounted device defined in claim 8 wherein the transition time is longer when the transition is triggered by the device-initiated action than when the transition is triggered by the user-initiated action.

10. A head-mounted device, comprising:
a camera configured to capture images of an environment;
a display configured to display passthrough display content that includes the images of the environment;
a lens through which the passthrough display content is viewable from an eye box; and
control circuitry configured to gradually reduce a maximum available brightness for the passthrough display content from a first value to a second value over a given time period, wherein the first value is used when the head-mounted device is donned and the second value is used after the given time period has passed, and wherein the first value is less than a maximum achievable brightness of the display.

11. The head-mounted device defined in claim 10 wherein the display is configured to overlay user interface elements onto the passthrough display content and wherein the user interface elements are permitted to use a brightness range that extends to the maximum achievable brightness of the display.

12. The head-mounted device defined in claim 10 wherein the display is configured to overlay virtual images onto the passthrough display content and wherein the virtual images are permitted to use a brightness range that extends to the maximum achievable brightness of the display.

13. The head-mounted device defined in claim 10 wherein the display is configured to overlay high-dynamic-range media onto the passthrough display content and wherein the high-dynamic-range media is permitted to use a brightness range that extends to the maximum achievable brightness of the display.

14. The head-mounted device defined in claim 10 wherein the control circuitry is configured to reduce the maximum available brightness for the passthrough display content from the second value to a third value in response to an application being launched on the display.

15. A head-mounted device, comprising:
a camera configured to capture live video of a real-world environment;
a display configured to:
display passthrough display content that includes the live video of the real-world environment; and
overlay virtual images onto the passthrough display content;

a lens through which the passthrough display content and the virtual images are viewable from an eye box; and
control circuitry configured to:
operate the display in a first display mode in which the passthrough display content has a first maximum allowable brightness and the virtual images have a first amount of headroom; and
operate the display in a second display mode in which the passthrough display content has a second maximum allowable brightness and the virtual images have a second amount of headroom, wherein the first maximum allowable brightness is greater than the second maximum allowable brightness and the first amount of headroom is less than the second amount of headroom.

16. The head-mounted device defined in claim 15 wherein the control circuitry automatically transitions the display from the first display mode to the second display mode after a given period of time passes from an initial donning of the head-mounted device.

17. The head-mounted device defined in claim 15 wherein the control circuitry transitions the display from the first display mode to the second display mode in response to a virtual reality application launching on the head-mounted device.

18. The head-mounted device defined in claim 15 wherein the control circuitry transitions the display from the second display mode to the first display mode in response to a movie ending on the display.

19. The head-mounted device defined in claim 15 wherein the first maximum allowable brightness is less than a maximum achievable brightness of the display.

Assignees

• Apple Inc

Inventors

• Pieri Elizabeth
• Baar Teun R
• Berardino Alexander G
• Cook David M
• Liu Peng
• Xia Zuo

Classifications

• G09G2320/0686

  with two or more screen areas displaying information with different brightness or colours · CPC title

• G09G2320/0613

  The adjustment depending on the type of the information to be displayed · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title