Devices, methods, and graphical user interfaces for system-wide behavior for 3D models

Patent metadata

Field	Value
Publication number	US-12099692-B2
Application number	US-202117372400-A
Country	US
Kind code	B2
Filing date	Jul 9, 2021
Priority date	Jan 24, 2018
Publication date	Sep 24, 2024
Grant date	Sep 24, 2024

Abstract

A computer system with a display and a touch-sensitive surface receives a request to display a first user interface that includes a first item, and, in response to the request, displays the first user interface with a representation of the first item. Depending on whether the first item corresponds to a respective virtual three-dimensional object, the first item is displayed either with a visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object or without the visual indication. In response to a request to display a second user interface, the second user interface is displayed with a representation of the second item. Depending on whether the second item corresponds to a respective virtual three-dimensional object, the representation of the second item is displayed with or without the visual indication.

First claim

What is claimed is:

1. A method, comprising:
at a device having a display and one or more sensors for detecting user inputs:
receiving a request to display a first user interface that includes a first item;
in response to the request to display the first user interface, displaying the first user interface with a representation of the first item, including:
in accordance with a determination that the first item corresponds to a respective virtual three-dimensional object, displaying the representation of the first item in the first user interface with a visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object; and,
in accordance with a determination that the first item does not correspond to a respective virtual three-dimensional object, displaying the representation of the first item in the first user interface without the visual indication;

after displaying the representation of the first item, receiving a request to display a second user interface that includes a second item; and,
in response to the request to display the second user interface, displaying the second user interface with a representation of the second item, including:
in accordance with a determination that the second item corresponds to a respective virtual three-dimensional object, displaying the representation of the second item in the second user interface with the visual indication to indicate that the second item corresponds to a second respective virtual three-dimensional object; and,
in accordance with a determination that the second item does not correspond to a second respective virtual three-dimensional object, displaying the representation of the second item in the second user interface without the visual indication, wherein the first user interface is a user interface of a first computer application that is a web browser application and the second user interface is a user interface of a second computer application that is a messaging application different from the first computer application, wherein:

the step of receiving the request to display the first user interface and the step of displaying the first user interface with the representation of the first item in response to the request to display the first user interface are repeated multiple times including at least one time when the first user interface includes a representation of a respective virtual three-dimensional object and that is displayed in the first user interface with the visual indication, and at least one time when the first user interface includes a representation of an object that does not correspond to a respective virtual three-dimensional object and the representation of the first item is displayed in the first user interface without the visual indication, and
the step of receiving the request to display the second user interface and the step of displaying the second user interface with the representation of the second item in response to the request to display the second user interface are repeated multiple times including at least one time when the second user interface includes a representation of a respective virtual three-dimensional object and that is displayed in the second user interface with the visual indication, and at least one time when the second user interface includes a representation of an object that does not correspond to a respective visual three-dimensional object and the representation of the second item is displayed in the second user interface without the visual indication.

2. The method of claim 1 , wherein:
the device includes one or more device orientation sensors; and
displaying the representation of the first item with the visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object includes:
in response to detecting a movement of the device that results in a change from a first device orientation to a second device orientation, displaying movement of the first item that corresponds to the change from the first device orientation to the second device orientation.

3. The method of claim 1 , wherein displaying the representation of the first item with the visual indication to indicate that the first item corresponds to a first respective virtual three-dimensional object includes:
in response to detecting a first input that scrolls the first user interface while the representation of the first item is displayed in the first user interface:
translating the representation of the first item on the display in accordance with scrolling of the first user interface; and
rotating the representation of the first item relative to a plane defined by the first user interface in accordance with a direction in which the first user interface is scrolled.

4. The method of claim 1 , including, while displaying the representation of the first item with the visual indication in the first user interface, displaying a representation of a third item, wherein the representation of the third item is displayed without the visual indication in order to indicate that the third item does not correspond to a virtual three-dimensional object.

5. The method of claim 1 , including, while displaying the representation of the second item with the visual indication in the second user interface, displaying a representation of a fourth item, wherein the representation of the fourth item is displayed without the visual indication in order to indicate that the fourth item does not correspond to a respective virtual three-dimensional object.

6. The method of claim 1 , wherein:
the representation of the first item displayed in the first user interface with the visual indication and the representation of the second item displayed in the second user interface with the visual indication share a predefined set of visual characteristics and/or behavioral characteristics.

7. The method of claim 1 , wherein the first item is an element of a web page.

8. The method of claim 1 , wherein the second item is an attachment or an element in a message.

9. The method of claim 1 , wherein the visual indication that the first item corresponds to the first respective virtual three-dimensional object includes an animation of the first item that occurs without requiring an input directed to the representation of the first item.

10. The method of claim 1 , wherein:
the device includes one or more cameras; and
the method includes:
while displaying the representation of the second item with the visual indication to indicate that the second item corresponds to the second respective virtual three-dimensional object, detecting a second input that is directed to the representation of the second item; and,
in response to detecting the second input and in accordance with a determination that the second input meets first criteria:
displaying a third user interface region on the display, including replacing display of at least a portion of the second user interface with a representation of a field of view of the one or more cameras; and

continuously displaying the second respective virtual three-dimensional object while switching from displaying the second user interface to displaying the third user interface region.

11. The method of claim 1 , wherein:
the device includes one or more cameras; and
the method includes:
while displaying the second item with the visual indication to indicate that the second item corresponds to the second respective virtual three-dimensional object, detecting a third input that is directed to the representation of the second item;
in response to detecting the third input and in accordance with a determination that

Assignees

• Apple Inc

Inventors

• Rockel Philipp
• Dascola Jonathan R
• Lemay Stephen O
• Faulkner Jeffrey M
• Yerkes Giancarlo

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title