Systems and methods of managing spatial groups in multi-user communication sessions

Patent metadata

Field	Value
Publication number	US-12113948-B1
Application number	US-202418421827-A
Country	US
Kind code	B1
Filing date	Jan 24, 2024
Priority date	Jun 4, 2023
Publication date	Oct 8, 2024
Grant date	Oct 8, 2024

Abstract

Some examples of the disclosure are directed to systems and methods for managing locations of users in a spatial group within a communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device and a second electronic device are in communication within a communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device. In some examples, in response to detecting an input corresponding to a request to display shared content in the three-dimensional environment, if the shared content is a first type of content, the first electronic positions the avatar a first distance away from the viewpoint, and if the shared content is a second type of content, the first electronic device positions the avatar a second distance away from the viewpoint.

First claim

What is claimed is:

1. A method comprising:
at a first electronic device in communication with a display, one or more input devices, a second electronic device and a third electronic device:
while in a communication session with the second electronic device and the third electronic device, displaying, via the display, a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device at a first location and a three-dimensional representation corresponding to a user of the third electronic device at a second location, different from the first location, in the computer-generated environment relative to a viewpoint of the first electronic device;
while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving, via the one or more input devices, a first input corresponding to a request to display content in the computer-generated environment; and
in response to receiving the first input, in accordance with a determination that the content corresponds to shared content:
displaying, via the display, a first object corresponding to the shared content in the computer-generated environment; and
displaying the three-dimensional representation corresponding to the user of the second electronic device at a first updated location and the three-dimensional representation corresponding to the user of the third electronic device at a second updated location, different from the first updated location, in the computer-generated environment relative to the viewpoint, including:
moving the three-dimensional representation of the user of the second electronic device to the first updated location and moving the three-dimensional representation of the user of the third electronic device to the second updated location in a respective direction that is selected based on a location of the first object.

2. The method of claim 1 , wherein the first object is a shared application window associated with an application operating on the first electronic device.

3. The method of claim 1 , wherein the first updated location and the second updated location are determined relative to a reference line in the computer-generated environment.

4. The method of claim 3 , wherein:
before receiving the first input, the user of the first electronic device, the user of the second electronic device, and the user of the third electronic device are arranged within a spatial group having a center point; and
the reference line extends between the location of the first object in the computer-generated environment and the center point of the spatial group.

5. The method of claim 4 , wherein the center point is determined based on a calculated average of the viewpoint of the first electronic device, the first location, and the second location.

6. The method of claim 3 , wherein:
the respective direction of movement of the three-dimensional representation corresponding to the user of the second electronic device is clockwise relative to the reference line in the computer-generated environment; and
the respective direction of movement of the three-dimensional representation corresponding to the user of the third electronic device is counterclockwise relative to the reference line in the computer-generated environment.

7. The method of claim 1 , further comprising:
before receiving the first input, detecting an indication of a change in state of the second electronic device; and
in response to detecting the indication:
replacing display of the three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device; and
displaying the three-dimensional representation corresponding to the user of the third electronic device at a third updated location relative to the viewpoint, including:
moving the three-dimensional representation of the user of the third electronic device to the third updated location in the respective direction that is selected based on a location of the two-dimensional representation of the user of the second electronic device.

8. The method of claim 1 , wherein the first electronic device, the second electronic device, and the third electronic device include a head-mounted display, respectively.

9. The method of claim 1 , wherein the three-dimensional representation of the user of the second electronic device and the three-dimensional representation of the user of the third electronic device are moved to the first updated location and the second updated location, respectively, in the respective direction with an animation of the movement.

10. The method of claim 1 , further comprising:
in response to receiving the first input, in accordance with a determination that the content corresponds to private content:
displaying, via the display, a second object corresponding to the private content in the computer-generated environment; and
maintaining display of the three-dimensional representation corresponding to the user of the second electronic device at the first location and maintaining display of the three-dimensional representation corresponding to the user of the third electronic device at the second location in the computer-generated environment.

11. The method of claim 10 , further comprising:
while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device, the three-dimensional representation corresponding to the user of the third electronic device, and the second object, receiving, via the one or more input devices, a second input corresponding to a request to share the private content with the user of the second electronic device and the user of the third electronic device; and
in response to receiving the second input:
redisplaying the second object as a shared object in the computer-generated environment; and
displaying the three-dimensional representation corresponding to the user of the second electronic device at a third updated location and the three-dimensional representation corresponding to the user of the third electronic device at a fourth updated location, different from the third updated location, in the computer-generated environment relative to the viewpoint, including:
moving the three-dimensional representation of the user of the second electronic device to the third updated location and moving the three-dimensional representation of the user of the third electronic device to the fourth updated location in the respective direction that is selected based on a location of the second object.

12. The method of claim 1 , further comprising:
while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, detecting an indication of a request to display shared content in the computer-generated environment; and
in response to detecting the indication:
displaying, via the display, a second object corresponding to the shared content in the computer-generated environment; and
updating the viewpoint of the first electronic device in the computer-generated environment relative to a location of the second object.

13. The method of claim 1 , wherein the viewpoint of the first electronic device, the first

Assignees

• Apple Inc

Inventors

• Smith Connor A
• Mattelaer Willem
• Cerra Joseph P
• Lee Kevin

Classifications

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title

• H04N7/157

  defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827) · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title