Devices, methods, and graphical user interfaces for displaying applications in three-dimensional environments

Patent metadata

Field	Value
Publication number	US-12265690-B2
Application number	US-202318523518-A
Country	US
Kind code	B2
Filing date	Nov 29, 2023
Priority date	Dec 23, 2019
Publication date	Apr 1, 2025
Grant date	Apr 1, 2025

Abstract

A computer system displays a first view of a user interface of a first application with a first size at a first position corresponding to a location of at least a portion of a palm that is currently facing a viewpoint corresponding to a view of a three-dimensional environment provided via a display generation component. While displaying the first view, the computer system detects a first input that corresponds to a request to transfer display of the first application from the palm to a first surface that is within a first proximity of the viewpoint. In response to detecting the first input, the computer system displays a second view of the user interface of the first application with a second size and an orientation that corresponds to the first surface at a second position defined by the first surface.

First claim

What is claimed is:

1. A method, comprising:
at a computer system including a display generation component and one or more input devices:
displaying, via the display generation component, a first view of a user interface of a first application at a first position within a view of a three-dimensional environment that corresponds to a location of at least a portion of a palm that is currently facing a viewpoint corresponding to the view of the three-dimensional environment that is provided via the display generation component, wherein the first view of the user interface of the first application is displayed with a first size;
while displaying the first view of the user interface of the first application at the first position within the view of the three-dimensional environment that corresponds to the location of at least the portion of the palm that is currently facing the viewpoint corresponding to the view of the three-dimensional environment that is provided via the display generation component, detecting a first input that corresponds to a request to transfer display of the first application from the palm to a first surface that is within a first proximity of the viewpoint corresponding to the view of the three-dimensional environment that is provided via the display generation component; and
in response to detecting the first input, displaying a second view of the user interface of the first application with an orientation that corresponds to the first surface at a second position defined by the first surface, wherein the second view of the user interface of the first application is displayed with a second size that is distinct from the first size.

2. The method of claim 1 , wherein:
the first view of the user interface of the first application that is displayed at the first position includes first content; and
the second view of the user interface of the first application that is displayed at the second position defined by the first surface includes second content that is different from the first content.

3. The method of claim 1 , wherein:
the first view of the user interface of the first application includes a first form of the first application with a first user interaction model; and
the second view of the user interface of the first application includes a second form of the first application with a second user interaction model that is different from the first user interaction model.

4. The method of claim 1 , wherein the palm is part of a first hand, the first input is a tap gesture provided by a second hand that is distinct from the first hand, and the tap gesture is detected at a location that corresponds to a predetermined portion of a three-dimensional user interface object that corresponds to the first view of the user interface of the first application.

5. The method of claim 1 , including:
while displaying the second view of the user interface of the first application at the second position defined by the first surface with the second size within the view of the three-dimensional environment, detecting a second input that corresponds to a request to transfer display of the first application from the first surface to a second surface that is within a second proximity of the viewpoint corresponding to the view of the three-dimensional environment; and
in response to detecting the second input, displaying a third view of the user interface of the first application with an orientation that corresponds to the second surface at a third position defined by the second surface.

6. The method of claim 5 , wherein the palm is part of a first hand, and wherein the second input includes a first gaze input directed to the second surface in conjunction with a first movement of the first hand that corresponds to a movement toward the second surface in the view of the three-dimensional environment.

7. The method of claim 6 , including:
while displaying the third view of the user interface of the first application at the third position defined by the second surface, detecting a third input that includes a second gaze input directed to the second surface in conjunction with a second movement of the first hand that meets preset criteria; and
in response to detecting the third input, redisplaying the first view of the user interface of the first application at the first position within the view of the three-dimensional environment that corresponds to the location of at least the portion of the palm.

8. The method of claim 5 , wherein the second view of the user interface of the first application presents content through a three-dimensional object that is subject to spatial manipulation in the three-dimensional environment, and the third view of the user interface of the first application presents content through a media-playback region defined by the second surface.

9. The method of claim 5 , wherein:
displaying the second view of the user interface of the first application with the orientation that corresponds to the first surface at the second position defined by the first surface includes selecting the second size of the second view of the user interface of the first application relative to a physical environment in accordance with a first set of characteristics of the first surface; and
displaying the third view of the user interface of the first application with the orientation that corresponds to the second surface at the third position defined by the second surface includes selecting a third size of the third view of the user interface of the first application relative to the physical environment in accordance with a second set of characteristics of the second surface, wherein the third size is different from the second size.

10. The method of claim 5 , wherein:
a respective input that corresponds to a respective request to transfer display of the first application from a first respective position corresponding to a first location in the three-dimensional environment, to a second respective position corresponding to a second location in the three-dimensional environment, includes a pinch and drag gesture directed toward the first location followed by a depinch gesture directed toward the second location.

11. The method of claim 5 , including:
while displaying a respective view of the user interface of the first application, detecting a pinch gesture directed to the respective view of the user interface of the first application; and
in response to detecting the pinch gesture directed to the respective view of the user interface of the first application, resizing the respective view of the user interface of the first application in accordance with the pinch gesture.

12. The method of claim 5 , including:
while displaying a respective view of the user interface of the first application at a respective position defined by a respective surface, detecting a pinch gesture directed to the respective view of the user interface of the first application; and
in response to detecting the pinch gesture directed to the respective view of the user interface of the first application, redisplaying the first view of the user interface of the first application at the first position within the view of the three-dimensional environment that corresponds to the location of at least the portion of the palm.

13. The method of claim 5 , wherein different views of the user interface of the first application correspond to different interaction models.

14. The method of claim 13 , wherein:
the first view of the user interface includes a first portion of the user interface corresponding to a first function of the first application and a second

Assignees

• Apple Inc

Inventors

• Lemay Stephen O
• Suzuki Gregg S
• Sundstrom Matthew J
• Ive Jonathan
• Faulkner Jeffrey M
• Dascola Jonathan R
• Sorrentino Iii William A
• Bauerly Kristi E S
• Yerkes Giancarlo
• Anton Peter D

Classifications

• G06F3/0485

  Scrolling or panning · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title