Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Patent metadata

Field	Value
Publication number	US-12198259-B2
Application number	US-202418433309-A
Country	US
Kind code	B2
Filing date	Feb 5, 2024
Priority date	Sep 25, 2020
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

A computer system displays a first user interface object with a first appearance at a first position in a first view of a three-dimensional environment that is at least partially shared between a first and second user. While displaying the first user interface object, the computer system detects a first user input by the first user. In response to detecting the first user input: in accordance with a determination that the second user is not currently interacting with the first user interface object, the computer system performs a first operation; and in accordance with a determination that the second user is currently interacting with the first user interface object, the computer system displays a visual indication, that the first user interface object is not available for interaction, including changing an appearance or position of the first user interface object, and forgoes performing the first operation.

First claim

What is claimed is:

1. A method, comprising:
at a computer system including a first display generation component and one or more first input devices:
displaying a first user interface object in a first view of a three-dimensional environment, wherein the three-dimensional environment is at least partially shared between a first user and a second user, wherein the first user interface object is displayed with a first set of appearance properties at a first position in the first view of the three-dimensional environment;
while displaying the first user interface object with the first set of appearance properties at the first position in the first view of the three-dimensional environment, detecting a first user input provided by the first user, wherein the first user input is directed to the first user interface object;
in response to detecting the first user input that is directed to the first user interface object:
in accordance with a determination that the second user is not currently interacting with the first user interface object, performing a first operation with respect to the first user interface object in accordance with the first user input; and
in accordance with a determination that the second user is currently interacting with the first user interface object:
displaying a visual indication that the first user interface object is not available for interaction with the first user, wherein displaying the visual indication includes changing at least one of an appearance of the first user interface object or a position of the first user interface object in the first view of the three-dimensional environment; and
forgoing performing the first operation with respect to the first user interface object in accordance with the first user input.

2. The method of claim 1 , wherein the computer system changes the appearance of the first user interface object as the visual indication that the first user interface object is not available for interaction with the first user, and wherein changing the appearance of the first user interface object includes changing at least one of the first set of appearance properties of the first user interface object to reduce visual prominence of the first user interface object.

3. The method of claim 2 , including:
detecting termination of the first user input that is directed to the first user interface object; and
in response to detecting the termination of the first user input that is directed to the first user interface object, restoring at least one of the first set of appearance properties of the first user interface object that was changed in response to the first user input, to restore the visual prominence of the first user interface object.

4. The method of claim 2 , including:
while continuing to detect the first user input, detecting movement of the first user interface object away from the first position in the first view of the three-dimensional environment independent of the detection of the first user input, and
in response to detecting the movement of the first user interface object away from the first position in the first view of the three-dimensional environment independent of the detection of the first user input, restoring at least one of the first set of appearance properties of the first user interface object that was changed in response to the first user input, to restore the visual prominence of the first user interface object.

5. The method of claim 1 , wherein changing the appearance of the first user interface object includes maintaining changes to the appearance of the first user interface object made in response to the first user input until the second user ceases to interact with the first user interface object.

6. The method of claim 1 , including:
in response to detecting the first user input that is directed to the first user interface object:
in accordance with a determination that the second user is not currently interacting with the first user interface object, displaying the first user interface object at a second position in the first view of the three-dimensional environment, wherein the second position is selected in accordance with a current location of a hand of the first user; and

while displaying the first user interface object at the second position that is selected in accordance with the current location of the hand of the first user, detecting movement of the hand of the first user that corresponds to a throwing gesture of the hand of the first user; and
in response to detecting the movement of the hand of the first user that corresponds to the throwing gesture of the hand of the first user, moving the first user interface object in the first view of the three-dimensional environment in a first direction that corresponds to a direction of the movement of the hand of the first user and rotating the first user interface object during movement of the first user interface object.

7. The method of claim 6 , wherein rotating the first user interface object during the movement of the first user interface object includes:
in accordance with a determination that the direction of the movement of the hand of the first user points toward a representation of the second user in the first view of the three-dimensional environment, rotating the first user interface object in a first manner such that the first user interface object has a first preset orientation in the three-dimensional environment when arriving at a destination position in the three-dimensional environment that is selected in accordance with the movement of the hand of the first user in a first physical environment.

8. The method of claim 6 , wherein rotating the first user interface object during the movement of the first user interface object includes:
in accordance with a determination that the direction of the movement of the hand of the first user points toward a representation of a first surface in the first view of the three-dimensional environment, rotating the first user interface object in a second manner such that the first user interface object has a second preset orientation relative to the representation of the first surface in the three-dimensional environment when arriving at a destination position on the representation of the first surface that is selected in accordance with the movement of the hand of the first user in a first physical environment.

9. The method of claim 1 , wherein the computer system changes the position of the first user interface object in the first view of the three-dimensional environment as the visual indication that the first user interface object is not available for interaction with the first user, and wherein changing the position of the first user interface object in the first view of the three-dimensional environment includes moving the first user interface object from the first position to maintain at least a preset distance between the first user interface object and a representation of a hand of the first user that provided the first user input.

10. The method of claim 1 , wherein performing the first operation with respect to the first user interface object in accordance with the first user input includes moving the first user interface object toward a representation of a hand of the first user.

11. The method of claim 1 , wherein performing the first operation with respect to the first user interface object in accordance with the first user input includes:
in accordance with a determination that the first user input includes a predefined selection gesture, selecting the first user interface object as a target for a subsequent input received from the first user.

12. The method of

Assignees

• Apple Inc

Inventors

• Rockel Philipp
• Henderson Nicholas W

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title