Devices, methods, and graphical user interfaces for real-time communication

Patent metadata

Field	Value
Publication number	US-12374069-B2
Application number	US-202418610103-A
Country	US
Kind code	B2
Filing date	Mar 19, 2024
Priority date	Jun 4, 2023
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for real-time communications.

First claim

What is claimed is:

1. A computer system configured to communicate with one or more display generation components, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the one or more display generation components and within a three-dimensional environment, a real-time communication user interface that corresponds to a real-time communication session between a user of the computer system and one or more participants in the real-time communication session different from the user of the computer system;
displaying, via the one or more display generation components, a first spatially-constrained representation of a first participant of the one or more participants in the real-time communication session, wherein the first spatially-constrained representation of the first participant includes:
a first portal that has a spatial position in the three-dimensional environment that is determined by the computer system; and
a first visual representation of the first participant that moves based on detected movement of the first participant, wherein the first visual representation is displayed at least partially within the first portal;

while displaying the first spatially-constrained representation of the first participant within the real-time communication user interface, detecting a request from a respective participant in the real-time communication session to transition from a spatially-constrained representation mode, in which the first participant in the real-time communication session is visually represented using the first spatially-constrained representation, to a spatially-flexible representation mode, in which the first participant in the real-time communication session is visually represented using a first spatially-flexible representation, wherein the spatially-flexible representation mode is different from the spatially-constrained representation mode; and
in response to detecting the request from the respective participant in the real-time communication session to transition from the spatially-constrained representation mode to the spatially-flexible representation mode:
displaying, via the one or more display generation components, the first spatially-flexible representation of the first participant that moves based on detected movement of the first participant and has a spatial position in the three-dimensional environment relative to one or more other objects in the three-dimensional environment that is determined at least in part based on movement of the first participant, wherein the spatially-flexible representation mode includes one of displaying the first participant without the first portal, displaying the first participant with the first portal having a non-visible border, and displaying the first participant with the first portal having a partially surrounding border.

2. The computer system of claim 1 , the one or more programs further including instructions for:
prior to displaying the real-time communication user interface that corresponds to the real-time communication session between the user of the computer system and one or more participants in the real-time communication session different from the user of the computer system, receiving, via one or more input devices, one or more user inputs corresponding to a user request to initiate the real-time communication session; and
in response to receiving the one or more user inputs corresponding to the user request to initiate the real-time communication session:
displaying, via the one or more display generation components and within the three-dimensional environment:
the real-time communication user interface; and
the first spatially-constrained representation of the first participant.

3. The computer system of claim 1 , wherein the first visual representation of the first participant is a three-dimensional representation that moves within the first portal based on detected movement of the first participant.

4. The computer system of claim 1 , wherein the first spatially-flexible representation of the first participant does not include the first portal.

5. The computer system of claim 1 , wherein the first portal displays visual content that is determined at least in part based on one or more video feeds captured by one or more cameras of a first external device being used by the first participant.

6. The computer system of claim 1 , the one or more programs further including instructions for:
in response to detecting the request from the respective participant in the real-time communication session to transition from the spatially-constrained representation mode to the spatially-flexible representation mode:
displaying the first spatially-flexible representation of the first participant at a first spatial position within the three-dimensional environment.

7. The computer system of claim 1 , wherein displaying the first spatially-flexible representation of the first participant is performed in accordance with a determination that at least two of the participants in the real-time communication session have requested to transition from the spatially-constrained representation mode to the spatially-flexible representation mode.

8. The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the first spatially-constrained representation of the first participant, receiving, via one or more input devices, a second set of user inputs corresponding to a user request to transition from the spatially-constrained representation mode to the spatially-flexible representation mode;
in response to receiving the second set of user inputs:
in accordance with a determination that less than a threshold number of participants in the real-time communication session have requested to transition from the spatially-constrained representation mode to the spatially-flexible representation mode, maintaining display of the first spatially-constrained representation of the first participant;

subsequent to receiving the second set of user inputs, and while displaying the first spatially-constrained representation of the first participant, receiving, via the one or more input devices a third set of user inputs corresponding to a repeated user request to transition from the spatially-constrained representation mode to the spatially-flexible representation mode; and
in response to receiving the third set of user inputs:
in accordance with a determination that less than a threshold number of participants in the real-time communication session have requested to transition from the spatially-constrained representation mode to the spatially-flexible representation mode, displaying a first indication that indicates that less than the threshold number of participants in the real-time communication session have requested to transition from the spatially-constrained representation mode to the spatially-flexible representation mode.

9. The computer system of claim 1 , wherein:
while the computer system displays the first spatially-constrained representation of the first participant, the user of the computer system is visually represented by one or more external devices corresponding to the one or more participants in the real-time communication session in a first manner; and
while the computer system displays the first spatially-flexible representation of the first participant, the user of the computer system is visually represented by the one or more external devices in a second manner different from the first manner.

10. The computer system of claim 1 , the one or m

Assignees

• Apple Inc

Inventors

• Chand Jesse
• Chiu Shih-Sang
• Holder Wesley M
• Lemay Stephen O
• Sorrentino Iii William A
• Bhardwaj Rajat
• Yerkes Giancarlo
• Rickwald Jason D
• Burton Rupert
• Coon Kaely
• Smith Connor A
• Cerra Joseph P
• Rochette Tommy

Classifications

• H04L65/1089

  by adding media; by removing media · CPC title

• H04L65/1086

  session scope modification · CPC title

• H04L65/1069 Primary

  Session establishment or de-establishment · CPC title

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title