Methods and systems for composing and executing a scene

Patent metadata

Field	Value
Publication number	US-12169902-B2
Application number	US-202217853557-A
Country	US
Kind code	B2
Filing date	Jun 29, 2022
Priority date	Sep 21, 2021
Publication date	Dec 17, 2024
Grant date	Dec 17, 2024

Abstract

In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

First claim

What is claimed is:

1. A method comprising:
scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;
displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;
scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and
in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

2. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding a size or shape of the first physical object.

3. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding an object type of the first physical object.

4. The method of claim 1 , wherein the at least one first object criterion includes a criterion regarding a usability of the first physical object.

5. The method of claim 4 , wherein the criterion regarding the usability of the first physical object is defined with respect to the virtual object.

6. The method of claim 4 , wherein the criterion regarding the usability of the first physical object is defined with respect to a fifth physical object.

7. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying a composite image of the virtual object and the first physical environment.

8. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes projecting the virtual object over a view of the first physical environment.

9. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object over a representation or view of the first physical object or the second physical object.

10. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object proximate to a representation or view of the first physical object or the second physical object.

11. The method of claim 1 , wherein displaying, in association with the first physical environment, the virtual object includes displaying the virtual object interacting with a representation or view of the first physical object or the second physical object.

12. The method of claim 1 , wherein a variance of the second path is different than a variance of the first path.

13. The method of claim 1 , wherein at least one of the first path or the second path is determined to avoid another object.

14. The method of claim 1 , further comprising:
in response to determining that the second physical environment does not include the third physical object that meets the at least one first object criterion:
forgo displaying the virtual object in association with the second physical environment; and
displaying a notification that the second physical environment is missing a physical object that meets the at least one first object criterion.

15. The method of claim 1 , further comprising:
in response to determining that the second physical environment does not include the third physical object that meets the at least one first object criterion or the fourth physical object that meets the at least one second object criterion:
displaying a rescan affordance to rescan the second physical environment;
detecting a user input selecting the rescan affordance; and
in response to detecting the user input selecting the rescan affordance, rescanning the second physical environment to determine whether the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion.

16. A device comprising:
a display;
non-transitory memory; and
one or more processors to:
scan a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;
display, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;
scan a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and
in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, display, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

17. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding a size or shape of the first physical object.

18. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding an object type of the first physical object.

19. The device of claim 16 , wherein the at least one first object criterion includes a criterion regarding a usability of the first physical object.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device including a display, cause the device to:
scan a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion;
display, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object;
scan a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment; and
in response to determining that the second physical environment includes the third physical object that meets the at least one first object criterion and the fourth physical object that meets the at least one second object criterion, display, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

Assignees

• Apple Inc

Inventors

• Drummond Mark E
• Kovacs Daniel L
• Budhram Shaun D
• Ahn Edward
• Mahasseni Behrooz
• Manglik Aashi
• Jotwani Payal
• Qiao Mu
• MORGAN Bo
• Gamboa Noah
• Gutensohn Michael J
• Feng Dan
• Sivapurapu Siva Chandra Mouli

Classifications

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06V10/987

  with the intervention of an operator · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06T2219/004

  Annotating, labelling · CPC title