Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Patent metadata

Field	Value
Publication number	US-11900527-B2
Application number	US-202218091119-A
Country	US
Kind code	B2
Filing date	Dec 29, 2022
Priority date	Sep 25, 2020
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

A computer system displays a first computer-generated experience that includes displaying one or more virtual elements in a three-dimensional environment with a first appearance. While displaying the one or more virtual elements with the first appearance, the computer system receives biometric data corresponding to respiration of a first user. In response to receiving the biometric data: in accordance with a determination that the biometric data corresponding to the respiration of the first user meets first criteria, the computer system displays the one or more virtual elements in the three-dimensional environment with a second appearance that is different from the first appearance; and in accordance with a determination that the biometric data corresponding to the first user does not meet the first criteria, the computer system continues to display the one or more virtual elements in the three-dimensional environment with the first appearance.

First claim

What is claimed is:

1. A method, comprising:
at a computer system that is in communication with a first display generation component and one or more first input devices:
displaying a first computer-generated experience that includes displaying one or more virtual elements in a three-dimensional environment with a first appearance;
while displaying the one or more virtual elements in the three-dimensional environment with the first appearance, receiving biometric data corresponding to respiration of a first user; and
in response to receiving the biometric data corresponding to the respiration of the first user:
in accordance with a determination that the biometric data corresponding to the respiration of the first user meets first criteria, displaying the one or more virtual elements in the three-dimensional environment with a second appearance that is different from the first appearance; and
in accordance with a determination that the biometric data corresponding to the first user does not meet the first criteria, continuing to display the one or more virtual elements in the three-dimensional environment with the first appearance.

2. The method of claim 1 , including:
while displaying the one or more virtual elements in the three-dimensional environment with the second appearance, receiving first updated biometric data corresponding to updated respiration of the first user; and
in response to receiving the first updated biometric data corresponding to the updated respiration of the first user:
in accordance with a determination that the first updated biometric data corresponding to the updated respiration of the first user meets second criteria different from the first criteria, displaying the one or more virtual elements with a third appearance that is different from the second appearance; and
in accordance with a determination that the first updated biometric data corresponding to the updated respiration of the first user meets the first criteria and does not meet the second criteria, continuing to display the one or more virtual elements with the second appearance.

3. The method of claim 1 , including:
while displaying the one or more virtual elements with a respective appearance of at least the second appearance and a third appearance different from the second appearance, receiving updated biometric data corresponding to updated respiration of the first user, wherein the respective appearance is different from the first appearance; and
in response to receiving the updated biometric data corresponding to updated respiration of the first user:
in accordance with a determination that the updated biometric data corresponding to the updated respiration of the first user does not meet respective criteria that were met to transition into displaying the one or more virtual elements in the three-dimensional environment with the respective appearance, displaying the one or more virtual elements with a respective appearance of the one or more virtual elements that is used prior to displaying the one or more virtual elements in the three-dimensional environment with the respective appearance.

4. The method of claim 1 , wherein the biometric data includes a respiration rate of the first user and the first criteria include a criterion that is met when the respiration rate of the first user is below a first threshold respiration rate in order for the first criteria to be met.

5. The method of claim 1 , wherein the first criteria include a requirement that the biometric data satisfy one or more preset threshold values for at least a threshold amount of time in order for the first criteria to be met.

6. The method of claim 1 , wherein:
displaying the one or more virtual elements in the three-dimensional environment with the first appearance includes displaying virtual content at respective first positions that correspond to locations of one or more first portions of a physical environment, while maintaining display of a representation of one or more second portions of the physical environment; and
displaying the one or more virtual elements in the three-dimensional environment with the second appearance includes displaying virtual content at the respective first positions that correspond to the locations of the one or more first portions of the physical environment and at respective second positions that correspond to at least some of the one or more second portions of the physical environment.

7. The method of claim 1 , including:
in response to receiving the biometric data corresponding to the respiration of the first user and in accordance with a determination that a change in the biometric data corresponding to the respiration of the first user is progressing toward meeting the first criteria:
gradually reducing visual emphasis of at least a portion of a representation of a physical environment that had been visible via the first display generation component while the one or more virtual elements are displayed with the first appearance, wherein displaying the one or more virtual elements in the three-dimensional environment with the second appearance includes displaying virtual content of the first computer-generated experience at a position corresponding to the portion of the representation of the physical environment such that the portion of the representation of the physical environment ceases to be visible via the first display generation component.

8. The method of claim 1 , including:
in response to receiving the biometric data corresponding to the respiration of the first user and in accordance with a determination that a change in the biometric data corresponding to the respiration of the first user is progressing toward meeting the first criteria:
changing a visual property of at least a portion of a representation of a physical environment that had been visible via the first display generation component while the one or more virtual elements are displayed with the first appearance in the three-dimensional environment by an amount that corresponds to the change in the biometric data corresponding to the respiration of the first user.

9. The method of claim 1 , including:
in response to receiving the biometric data corresponding to the respiration of the first user and in accordance with a determination that a change in the biometric data corresponding to the respiration of the first user is progressing toward meeting the first criteria:
expanding display of virtual content onto at least a portion of a representation of a physical environment that had been visible via the first display generation component while the one or more virtual elements were displayed with the first appearance, by an amount that corresponds to the change in the biometric data corresponding to the respiration of the first user.

10. The method of claim 1 , wherein the first criteria include a criterion that the first user makes less than a threshold amount of movement of a first type when the biometric data is being received in order for the first criteria to be met.

11. The method of claim 1 , including:
while displaying the first computer-generated experience including displaying the one or more virtual elements with the second appearance, detecting movement of a first type being performed by the first user; and
in response to detecting the movement of the first type being performed by the first user:
in accordance with a determination that the movement of the first type exceeds a preset threshold amount of movement, redisplaying the one or more virtual elements with the first appearance.

12. The method of claim 1 , including:
while displaying the one or more virtual ele

Assignees

• Apple Inc

Inventors

• Rockel Philipp
• Butcher Gary I
• Dargan Dorian D

Classifications

• G06T15/10 Primary

  Geometric effects · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• A63F13/426

  involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun · CPC title