Devices, methods, and graphical user interfaces for presenting virtual objects in virtual environments

Patent metadata

Field	Value
Publication number	US-12299251-B2
Application number	US-202217932999-A
Country	US
Kind code	B2
Filing date	Sep 16, 2022
Priority date	Sep 25, 2021
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

In some embodiments, an electronic device updates the spatial arrangement of one or more virtual objects in a three-dimensional environment. In some embodiments, an electronic device updates the positions of multiple virtual objects together. In some embodiments, an electronic device displays objects in a three-dimensional environment based on an estimated location of a floor in the three-dimensional environment. In some embodiments, an electronic device moves (e.g., repositions) objects in a three-dimensional environment.

First claim

What is claimed is:

1. A method comprising:
at an electronic device in communication with a display generation component and one or more input devices:
while displaying, via the display generation component, a three-dimensional environment including a plurality of virtual objects with a first spatial arrangement relative to a current viewpoint of a user of the electronic device that corresponds to respective poses of the plurality of virtual objects in the three-dimensional environment, detecting, via the one or more input devices, movement of the current viewpoint of the user in the three-dimensional environment from a first viewpoint to a second viewpoint;
in response to detecting the movement corresponding to movement of the current viewpoint of the user from the first viewpoint to the second viewpoint, displaying, via the display generation component, the three-dimensional environment from the second viewpoint including the plurality of virtual objects with a second spatial arrangement, different from the first spatial arrangement, relative to the current viewpoint of the user;
while displaying the three-dimensional environment from the second viewpoint including the plurality of virtual objects with the second spatial arrangement relative to the current viewpoint of the user that corresponds to the respective poses of the plurality of virtual objects in the three-dimensional environment, receiving, via the one or more input devices, an input corresponding to a request to update a spatial arrangement of the plurality of virtual objects relative to the current viewpoint of the user to satisfy one or more criteria that specify a range of distances or a range of orientations of virtual objects relative to the current viewpoint of the user; and
in response to the input corresponding to the request to update the three-dimensional environment, displaying, via the display generation component, the three-dimensional environment from the second viewpoint including displaying the plurality of virtual objects with a third spatial arrangement that corresponds to updated poses of the plurality of virtual objects in the three-dimensional environment that are different from the respective poses of the plurality of virtual objects in the three-dimensional environment, wherein the third spatial arrangement is different from the second spatial arrangement, relative to the current viewpoint of the user, wherein the third spatial arrangement of the plurality of virtual objects satisfies the one or more criteria.

2. The method of claim 1 , wherein receiving the input corresponding to the request to update the spatial arrangement of the plurality of virtual objects includes receiving the input via a hardware input device of the one or more input devices.

3. The method of claim 2 , wherein the input corresponding to the request to update the spatial arrangement of the plurality of virtual objects satisfies one or more first input criteria, and the method further comprises:
receiving, via the hardware input device, a second input; and
in response to receiving the second input:
in accordance with a determination that the second input satisfies one or more second input criteria different from the one or more first input criteria, performing a respective operation corresponding to the second input without updating the spatial arrangement of the plurality of virtual objects.

4. The method of claim 1 , wherein receiving the input corresponding to the request to update the spatial arrangement of the plurality of virtual objects includes detecting selection of a user interface element displayed in the three-dimensional environment via the display generation component.

5. The method of claim 1 , wherein displaying the plurality of virtual objects with the second spatial arrangement includes displaying, via the display generation component, the plurality of virtual objects at first positions in the three-dimensional environment, and the method further comprises:
in response to receiving the input, moving the plurality of virtual objects from the first positions to second positions in the three-dimensional environment.

6. The method of claim 1 , further comprising:
while displaying, via the display generation component, the three-dimensional environment including a respective virtual object of the plurality of virtual objects at a first position in the three-dimensional environment, wherein the spatial arrangement of the plurality of virtual objects relative to the current viewpoint of the user is a first respective spatial arrangement that satisfies the one or more criteria, receiving, via the one or more input devices, an input corresponding to a request to update a position of the respective virtual object in the three-dimensional environment;
in response to the input corresponding to the request to update the position of the respective virtual object in the three-dimensional environment, displaying, via the display generation component, the plurality of virtual objects with a second respective spatial arrangement that does not satisfy the one or more criteria, including displaying the respective virtual object at a second position, different from the first position, in the three-dimensional environment;
while displaying the three-dimensional environment including displaying the respective virtual object at the second position in the three-dimensional environment, receiving, via the one or more input devices, a second input corresponding to a request to update the spatial arrangement of the plurality of virtual objects relative to the current viewpoint of the user to satisfy the one or more criteria; and
in response to receiving the second input, updating the position of the respective virtual object to satisfy the one or more criteria without updating positions of one or more other virtual objects in the plurality of virtual objects.

7. The method of claim 1 , wherein displaying the plurality of virtual objects with the third spatial arrangement includes:
in accordance with a determination that the three-dimensional environment is associated with a first spatial template, displaying, via the display generation component, the plurality of virtual objects with the third spatial arrangement includes displaying, via the display generation component, a respective virtual object of the plurality of virtual objects with an orientation relative to the current viewpoint of the user that satisfies one or more criteria associated with the first spatial template, and
in accordance with a determination that the three-dimensional environment is associated with a second spatial template, displaying, via the display generation component, the plurality of virtual objects with the third spatial arrangement includes displaying, via the display generation component, the respective virtual object of the plurality of virtual objects with an orientation relative to the current viewpoint of the user that satisfies one or more criteria associated with the second spatial template.

8. The method of claim 7 , wherein displaying the plurality of virtual objects with the third spatial arrangement includes:
in accordance with a determination that the three-dimensional environment is associated with a shared content spatial template, displaying, via the display generation component, the respective virtual object of the plurality of virtual objects at a pose that orients a respective side of the respective virtual object towards the current viewpoint of the user and a second viewpoint of a second user in the three-dimensional environment.

9. The method of claim 7 , wherein displaying the plurality of virtual objects with the third spatial arrangement includes:
In accordance with a determ

Assignees

• Apple Inc

Inventors

• Mckenzie Christopher D
• Gitter Nathan
• Palangie Alexis H
• Chiu Shih-Sang
• Boesel Benjamin H
• Dargan Dorian D
• Taylor Zoey C

Classifications

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title