Controlling representations of virtual objects in a computer-generated reality environment

Patent metadata

Field	Value
Publication number	US-2025181144-A1
Application number	US-202519047546-A
Country	US
Kind code	A1
Filing date	Feb 6, 2025
Priority date	Sep 27, 2019
Publication date	Jun 5, 2025
Grant date	—

Abstract

In accordance with some embodiments, an exemplary process for controlling representations of virtual objects based on respective user contexts that each correspond to different respective locations in a computer-generated reality (CGR) environment is described.

First claim

What is claimed is:

1 . A system, comprising:
a display;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display, a two-dimensional (2D) representation of a virtual object at a first location of a computer-generated reality (CGR) environment;
receiving a request to concurrently display a three-dimensional (3D) representation of the virtual object with the 2D representation; and
in response to the request, concurrently displaying, via the display, the 2D representation at the first location and the 3D representation at a second location of the CGR environment, wherein the second location is different from the first location, and wherein the 2D representation and the 3D representation include a different number of interactive user interface (UI) elements.

2 . The system of claim 1 , wherein receiving the request to concurrently display includes receiving a request to drag the 2D representation of the virtual object from the first location to the second location of the CGR environment.

3 . The system of claim 1 , wherein the request to concurrently display includes a selection of an interactive element displayed with the 2D representation of the virtual object.

4 . The system of claim 1 , wherein concurrently displaying the 2D representation at the first location and the 3D representation at a second location of the CGR environment includes animating of the 3D representation as popping out the 2D representation.

5 . The system of claim 1 , the one or more programs further including instructions for:
in response to receiving a first request to modify the 2D representation:
modifying the 3D representation in accordance with a modification corresponding to the first request to modify the 2D representation; and
in response to receiving a first request to modify the 3D representation:
modifying the 2D representation in accordance with a modification corresponding to the first request to modify the 3D representation.

6 . The system of claim 5 , the one or more programs further including instructions for:
in response to receiving a second request to modify the 2D representation:
forgo modifying the 3D representation in accordance with a modification corresponding to the second request to modify the 2D representation; and
in response to receiving a second request to modify the 3D representation:
forgo modifying the 2D representation in accordance with a modification corresponding to the second request to modify the 3D representation.

7 . The system of claim 1 , wherein the 2D representation of the virtual object includes at least one interactive user interface-element.

8 . The system of claim 7 , wherein the at least one interactive UI element of the 2D representation is not included in the 3D representation of the virtual object.

9 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a system having a display, the one or more programs including instructions for:
displaying, via the display, a two-dimensional (2D) representation of a virtual object at a first location of a computer-generated reality (CGR) environment; receiving a request to concurrently display a three-dimensional (3D) representation of the virtual object with the 2D representation; and in response to the request, concurrently displaying, via the display, the 2D representation at the first location and the 3D representation at a second location of the CGR environment, wherein the second location is different from the first location, and wherein the 2D representation and the 3D representation include a different number of interactive user interface (UI) elements.

10 . A method, comprising:
displaying, via a display of a wearable electronic device, a two-dimensional (2D) representation of a virtual object at a first location of a computer-generated reality (CGR) environment; receiving a request to concurrently display a three-dimensional (3D) representation of the virtual object with the 2D representation; and in response to the request, concurrently displaying, via the display of the wearable electronic device, the 2D representation at the first location and the 3D representation at a second location of the CGR environment, wherein the second location is different from the first location, and wherein the 2D representation and the 3D representation include a different number of interactive user interface (UI) elements.

Assignees

• Apple Inc

Inventors

• Burns Aaron M
• Gitter Nathan
• Palangie Alexis H
• Pla I Conesa Pol
• Schattel David M

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title