Devices, methods, and graphical user interfaces for displaying applications in three-dimensional environments

Patent metadata

Field	Value
Publication number	US-11875013-B2
Application number	US-202017118487-A
Country	US
Kind code	B2
Filing date	Dec 10, 2020
Priority date	Dec 23, 2019
Publication date	Jan 16, 2024
Grant date	Jan 16, 2024

Abstract

A computer system detects a wrist. In accordance with a determination that first criteria that require an inner side of the wrist facing toward a viewpoint are met, the computer system displays a first user interface object including a plurality of representations of different applications at a first position corresponding to a first location on the wrist. While displaying the first user interface object, the computer system detects that the wrist's position or orientation has changed to satisfying second criteria that requires an outer side of the wrist facing toward the viewpoint. In response, the computer system switches from displaying the first user interface object at the first position to displaying a second user interface object including a plurality of controls for controlling functions at a second position corresponding to a location on a back of a hand attached to the wrist.

First claim

What is claimed is:

1. A method, comprising:
at a computer system including a display generation component and one or more input devices:
detecting presence of a wrist at a location that corresponds to a position within a view of a three-dimensional environment that is provided via the display generation component;
in response to detecting the presence of the wrist at the location that corresponds to the position within the view of the three-dimensional environment that is provided via the display generation component:
in accordance with a determination that first criteria are met by the presence of the wrist at the location that corresponds to the position in the view of the three-dimensional environment that is provided via the display generation component, wherein the first criteria require that an inner side of the wrist is facing toward a viewpoint corresponding to the view of the three-dimensional environment that is provided via the display generation component, displaying, via the display generation component, a first user interface object, including a plurality of representations corresponding to different applications, at a first position within the view of the three-dimensional environment that corresponds to a first location on the wrist;

while displaying the first user interface object at the first position within the view of the three-dimensional environment that corresponds to the first location on the wrist, detecting that the wrist has changed from satisfying the first criteria to satisfying second criteria, wherein the second criteria require that an outer side of the wrist is facing toward the viewpoint corresponding to the view of the three-dimensional environment that is provided via the display generation component;
in response to detecting that the wrist has changed from satisfying the first criteria to satisfying the second criteria, switching from displaying the first user interface object at the first position within the view of the three-dimensional environment that corresponds to the first location on the wrist to displaying, via the display generation component, a second user interface object, including a plurality of controls for controlling functions for the computer system, at a second position within the view of the three-dimensional environment that corresponds to a location on a back of a hand that is attached to the wrist, wherein the second user interface object is displayed while the wrist continues to satisfy the second criteria;
while displaying the second user interface object that includes the plurality of controls for controlling functions of the computer system, detecting a user input directed to a respective control of the plurality of controls; and
in response to detecting the user input, performing a function corresponding to the respective control.

2. The method of claim 1 , including:
in response to detecting that the wrist has changed from satisfying the first criteria to satisfying the second criteria, displaying one or more notifications corresponding to one or more applications at a third position within the view of the three-dimensional environment that corresponds to a location on the back of the hand that is attached to the wrist.

3. The method of claim 1 , including:
while displaying the plurality of controls for controlling functions for the computer system at the second position within the view of the three-dimensional environment that corresponds to the location on the back of the hand that is attached to the wrist, displaying one or more notifications corresponding to one or more applications at a fourth position within the view of the three-dimensional environment that corresponds to a location on a back side of the wrist.

4. The method of claim 1 , including:
while displaying the plurality of representations corresponding to different applications at the first position within the view of the three-dimensional environment that corresponds to the first location on the wrist and while the inner side of the wrist is facing toward the viewpoint corresponding to the view of the three-dimensional environment, detecting a swipe gesture on or proximate to the inner side of the wrist; and
in response to detecting the swipe gesture on or proximate to the inner side of the wrist, scrolling the plurality of representations corresponding to different applications in a direction that corresponds to a direction of the swipe gesture on or proximate to the inner side of the wrist.

5. The method of claim 1 , including:
in response to detecting the presence of the wrist at the location that corresponds to the position within the view of the three-dimensional environment that is provided via the display generation component:
in accordance with a determination that second criteria are met when the presence of a palm that is connected to the inner side of the wrist is detected at a location that corresponds to a position within the view of the three-dimensional environment, displaying a view of a user interface of a first application at a fifth position within the view of the three-dimensional environment that corresponds to at least a portion of the palm connected to the inner side of the wrist.

6. The method of claim 5 , wherein the second criteria require that the palm is facing toward the viewpoint corresponding to the view of the three-dimensional environment in order for the second criteria to be met.

7. The method of claim 5 , wherein the second criteria require that a gaze input is directed to the palm that is connected to the inner side of the wrist in order for the second criteria to be met.

8. The method of claim 1 , wherein the first user interface object includes an affordance that, when activated, causes display of a user interface for selecting at least one application for which a representation is to be added to the first user interface object.

9. The method of claim 1 , including:
while displaying the first user interface object at the first position within the view of the three-dimensional environment that corresponds to the first location on the wrist, detecting movement of the wrist; and
in response to detecting the movement of the wrist:
in accordance with a determination that the first criteria continues to be met by the presence of the wrist at a location that corresponds to a position in the view of the three-dimensional environment that is provided via the display generation component, moving the first user interface object, including the plurality of representations corresponding to different applications, within the view of the three-dimensional environment such that the first user interface object continues to be displayed at a position that corresponds to the first location on the wrist.

10. The method of claim 1 , including:
while displaying the first user interface object at the first position within the view of the three-dimensional environment that corresponds to the first location on the wrist, detecting a gesture on or proximate to the wrist at a location that corresponds to a respective position of the first user interface object in the view of the three-dimensional environment; and
in response to detecting the gesture on or proximate to the wrist at the location that corresponds to the respective position of the first user interface object in the view of the three-dimensional environment:
in accordance with a determination that the gesture meets third criteria, displaying the plurality of representations corresponding to different applications at a sixth position in the view of the three-dimensional environment that is independent of the location of the wrist.

11. The method of claim 1 , including:
wh

Assignees

• Apple Inc

Inventors

• Lemay Stephen O
• Suzuki Gregg S
• Sundstrom Matthew J
• Ive Jonathan
• Tilton Robert T
• Faulkner Jeffrey M
• Dascola Jonathan R
• Sorrentino Iii William A
• Bauerly Kristi E S
• Yerkes Giancarlo
• Anton Peter D

Classifications

• G06F3/04815 Primary

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0485

  Scrolling or panning · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title