Interfaces for presenting avatars in three-dimensional environments

Patent metadata

Field	Value
Publication number	US-2025022237-A1
Application number	US-202418898454-A
Country	US
Kind code	A1
Filing date	Sep 26, 2024
Priority date	Feb 16, 2021
Publication date	Jan 16, 2025
Grant date	—

Abstract

In some embodiments, a computer system displays user interfaces for enrolling one or more features of a user of a computer system. In some embodiments, a computer system displays visual effects associated with a virtual avatar in an XR environment. In some embodiments, a computer system displays objects having different visual characteristics in an XR environment. In some embodiments, a computer system switches between different presentation modes associated with a user represented in an XR environment. In some embodiments, a computer system displays a virtual avatar in an XR environment.

First claim

What is claimed is:

1 . A computer system, wherein the computer system is in communication with a display generation component and an external computer system that is associated with a first user, the computer system comprising:
one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display generation component, a communication user interface that includes a representation of the first user of the external computer system in a first presentation mode, wherein:
the communication user interface displays the representation of the first user in an extended reality environment; and
the representation of the first user, while in the first presentation mode, has a shape that is visually reactive to changes in movement of a first portion of the first user that are detected by the external computer system;

while displaying the representation of the first user in the first presentation mode:
receiving first data, from the external computer system, that indicates movement of the first portion of the first user; and
in response to receiving the first data, modifying the shape of the representation of the first user based on the movement of the first portion of the first user;

after modifying the shape of the representation of the first user, receiving second data indicating that the representation of the first user is to be displayed in a second presentation mode, different than the first presentation mode;
in response to receiving the second data, displaying, via the display generation component, the representation of the first user in the second presentation mode, wherein the representation of the first user, while in the second presentation mode, has a shape that is not visually reactive to changes in movement of the first portion of the first user that are detected by the external computer system; and
while displaying the representation of the first user in the second presentation mode:
receiving third data indicating movement of the first user from a first location in a physical environment to a second location in the physical environment different from the first location in the physical environment; and
in response to receiving the third data, displaying the representation of the first user moving from a first location in the extended reality environment to a second location in the extended reality environment different from the first location in the extended reality environment.

2 . The computer system of claim 1 , wherein the first portion of the first user includes at least a portion of a hand of the first user.

3 . The computer system of claim 1 , the one or more programs further including instructions for:
in response to receiving the second data, displaying, via the display generation component, an animation of the representation of the first user transitioning from the first presentation mode to the second presentation mode.

4 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes a set of one or more colors that is selected based on one or more colors that are associated with the first user.

5 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes a set of one or more colors that is selected from a predetermined set of color palettes.

6 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes a set of one or more colors that is selected from a set of warm color palettes.

7 . The computer system of claim 6 , the one or more programs further including instructions for:
displaying, via the display generation component, a representation of a system element, wherein the representation of the system element includes a set of one or more colors that is selected from a set of cool color palettes.

8 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the representation of the first user in the second presentation mode:
receiving data representing audio received from the first user; and
in response to receiving the data representing audio received from the first user, modifying an appearance of the representation of the first user in the second presentation mode in response to detected changes in one or more characteristics of the audio received from the first user.

9 . The computer system of claim 8 , the one or more programs further including instructions for:
while displaying the representation of the first user in the first presentation mode:
receiving data representing audio received from the first user; and
in response to receiving the data representing audio received from the first user, forgoing modifying an appearance of the representation of the first user in the first presentation mode in response to detected changes in one or more characteristics of the audio received from the first user.

10 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode changes at least a portion of its appearance independent of audio outputted by the first user.

11 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes an element having a two-dimensional or substantially two-dimensional appearance.

12 . The computer system of claim 11 , wherein:
the external computer system is in communication with a second external computer system that is associated with a second user, displaying the representation of the first user in the second presentation mode includes displaying, via the display generation component, the element having a first position in the extended reality environment facing a user of the computer system in the extended reality environment, and the second external computer system displays the representation of the first user in the second presentation mode, including displaying the element having a second position in the extended reality environment facing the second user in the extended reality environment.

13 . The computer system of claim 11 , the one or more programs further including instructions for:
while displaying the representation of the first user in the second presentation mode having a first displayed size:
receiving fourth data from the external computer system; and
in response to receiving the fourth data, displaying the element changing from a second displayed size to a third displayed size different from the second displayed size.

14 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes a visual indication of a mute status of the first user.

15 . The computer system of claim 1 , wherein the representation of the first user in the second presentation mode includes a visual indication of an identification of the first user.

16 . The computer system of claim 1 , wherein:
the representation of the first user in the first presentation mode includes an avatar having an avatar head feature, and displaying the representation of the first user in the second presentation mode includes ceasing display of the avatar and displaying the representation of the first user in the second presentation mode at a first location that overlaps a second location that was previously occupied by the avatar head feature.

17 . A non-transitory comp

Assignees

• Apple Inc

Inventors

• Burton Rupert Thomas Guy
• Butcher Gary Ian
• Dargan Dorian D
• Rickwald Jason
• Yerkes Giancarlo

Classifications

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06V40/168

  Feature extraction; Face representation · CPC title

• G06V40/174

  Facial expression recognition · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title