Devices, methods, and graphical user interfaces for providing computer-generated experiences

Patent metadata

Field	Value
Publication number	US-12307066-B2
Application number	US-202117200676-A
Country	US
Kind code	B2
Filing date	Mar 12, 2021
Priority date	Mar 16, 2020
Publication date	May 20, 2025
Grant date	May 20, 2025

Abstract

A computing system displays, via a first display generation component, a first computer-generated environment and concurrently displays, via a second display generation component: a visual representation of a portion of a user of the computing system who is in a position to view the first computer-generated environment via the first display generation component, and one or more graphical elements that provide a visual indication of content in the first computer-generated environment. The computing system changes the visual representation of the portion of the user to represent changes in an appearance of the user over a respective period of time and changes the one or more graphical elements to represent changes in the first computer-generated environment over the respective period of time.

First claim

What is claimed is:

1. A method, comprising:
at a computing system that is in communication with a first display generation component, a second display generation component and one or more input devices, wherein the first display generation component and the second display generation component are enclosed in a first housing:
displaying, via the first display generation component, a first computer-generated environment;
while displaying the first computer-generated environment via the first display generation component, in accordance with a determination that the first computer-generated environment includes a representation of a physical environment that shows a view of a first portion of a first physical environment that is in front of a user who is in a position to view the first computer-generated environment via the first display generation component, concurrently displaying, via the second display generation component that is enclosed in the same first housing as the first display generation component:
a visual representation of a portion of the user who is in a position to view the first computer-generated environment via the first display generation component, and
one or more graphical elements that provide a visual indication of content in the first computer-generated environment, wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes:
changing the visual representation of the portion of the user to represent changes in an appearance of the user over a respective period of time; and
changing the one or more graphical elements that provide the visual indication of content in the first computer-generated environment to represent changes in the first computer-generated environment over the respective period of time; and

while displaying the first computer-generated environment via the first display generation component, in accordance with a determination that the first computer-generated environment does not include a representation of a physical environment that shows a view of the first portion of the first physical environment that is in front of the user who is in a position to view the first computer-generated environment via the first display generation component, displaying the one or more graphical elements, via the second display generation component that is enclosed in the same first housing as the first display generation component, without displaying the visual representation of the portion of the user who is in a position to view the first computer-generated environment via the first display generation component.

2. The method of claim 1 , wherein changing the visual representation of the portion of the user to represent changes in the appearance of the user over the respective period of time includes:
in accordance with movement of the portion of the user in a first direction relative to the first display generation component, displaying movement of the visual representation of the portion of the user in the first direction on the second display generation component; and
in accordance with movement of the portion of the user in a second direction relative to the first display generation component, the second direction being within a threshold angle of a respective direction that is perpendicular to the first direction, displaying movement of the visual representation of the portion of the user in a third direction on the second display generation component, the third direction being within the threshold angle of a respective direction that is opposite to the second direction.

3. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes generating the visual representation of the portion of the user in accordance with a predefined characteristic value that is specified for a first display property of the visual representation.

4. The method of claim 3 , wherein the predefined characteristic value that is specified for the first display property of the visual representation includes a predefined amount of reduction for an opacity of the visual representation of the portion of the user.

5. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes applying a predefined visual effect on the visual representation of the portion of the user.

6. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements via the second display generation component includes displaying a diffused colored layer between the visual representation of the portion of the user and the one or more graphical elements that provide the visual indication of the content of the first computer-generated environment.

7. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements via the second display generation component includes displaying the visual representation of the portion of the user with a first graphical resolution and displaying the one or more graphical elements that provide the visual indication of the content of the first computer-generated environment with a second graphical resolution that is different from the first graphical resolution.

8. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes:
in accordance with a determination that a first change in the appearance of the user is detected, changing the visual representation of the portion of the user in accordance with the first change in the appearance of the user without changing the one or more graphical elements that provide the visual indication of the content in the first computer-generated environment.

9. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes:
in accordance with a determination that a second change in the content in the first computer-generated environment is detected while the appearance of the user remains unchanged, changing at least one of the one or more graphical elements that provide the visual indication of the content in the first computer-generated environment in accordance with the second change in the content in the first computer-generated environment without changing the visual representation of the portion of the user.

10. The method of claim 1 , wherein concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes:
in accordance with a determination that a third change in the appearance of the user is detected with a fourth change in the content in the first computer-generated environment, changing the visual representation of the portion of the user in accordance with the third change in the appearance of the user in conjunction with changing the one or more graphical elements that provide the visual indication of the content in the first computer-generated environment in accordance with the fourth change in the content in the first computer-generated environment.

11. The method of claim 1 , wherein:
concurrently displaying the visual representation of the portion of the user and the one or more graphical elements includes displaying a modified version of the content concurrently with the visual representation of the portion of the user, wherein the modified version of the content is generated with on

Assignees

• Apple Inc

Inventors

• Sorrentino Iii William A
• Ive Jonathan
• Huergo Wagner Alfred B
• Bacim De Araujo E Silva Felipe
• Dye Alan C
• Lemay Stephen O
• Suzuki Gregg S
• Anton Peter D
• Lyons Richard D
• Wan Wan Si
• Pivonka Pavel
• Kim Sueng Wook
• Bauerly Kristi E S

Classifications

• G02B2027/0141

  characterised by the informative content of the display · CPC title

• H04N13/368

  for two or more viewers · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04M2203/1025

  of avatars · CPC title