Computationally efficient model selection

Patent metadata

Field	Value
Publication number	US-11373377-B2
Application number	US-202117203393-A
Country	US
Kind code	B2
Filing date	Mar 16, 2021
Priority date	Sep 28, 2018
Publication date	Jun 28, 2022
Grant date	Jun 28, 2022

Abstract

In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.

First claim

What is claimed is:

1. A method comprising:
at an electronic device including a processor and non-transitory memory:
obtaining a first environment state, associated with a first environment time, of an environment, wherein the first environment state indicates inclusion in the environment of one or more assets and further indicates one or more states of the one or more assets;
determining, according to a first model and based on the first environment state, a second environment state associated with a second environment time;
receiving an input indicative of a timestep from the second environment time to a third environment time, wherein the timestep is different than a difference between the first environment time and the second environment time;
determining, according to a second model, different than the first model, and based on the second environment state, a third environment state associated with the third environment time.

2. The method of claim 1 , wherein the first environment state includes an XML file.

3. The method of claim 1 , wherein the first environment state, second environment state, and third environment state include data indicating:
the inclusion of a first asset of the one or more assets;
a type of the first asset;
a respective location of the first asset in the environment; and
a respective age of the first asset.

4. The method of claim 1 , further comprising:
displaying the environment having the first environment state at a first time;
displaying the environment having the second environment state at a second time a frame time later than the first time; and
displaying the environment having the third environment state at a third time the frame time later than the second time.

5. The method of claim 1 , wherein receiving the input indicative of the timestep includes receiving user input indicative of a selection of one of a plurality of timescale affordances respectively associated with a plurality of timesteps.

6. The method of claim 1 , wherein the second model is more computationally efficient than the first model.

7. The method of claim 1 , wherein:
determining, in accordance with the first model, the second environment state includes determining a second value of an asset state of the second environment state based on a first value of the asset state of the first environment state; and
determining, in accordance with the second model, the third environment state includes determining a third value of the asset state of the third environment state independent of the second value of the asset state of the second environment state.

8. The method of claim 1 , wherein:
determining, in accordance with the first model, the second environment state includes determining a second value of an asset state of the second environment state based on the first environment state; and
determining, in accordance with the second model, the third environment state includes forgoing determining a third value of the asset state of the third environment state based on the second environment state.

9. The method of claim 1 , wherein:
determining, in accordance with the first model, the second environment state includes determining a second value of an asset state of the second environment state based on a first value of the asset state of the first environment state; and
determining, in accordance with the second model, the third environment state includes excluding the asset having the asset state from the third environment state.

10. The method of claim 9 , wherein determining, in accordance with the second model, the third environment state includes including one or more new assets having the same asset type as the asset having the asset state based on a number of assets having a respective asset type in the second environment state.

11. The method of claim 1 , wherein determining, in accordance with the second model, the third environment state includes determining a third value of an asset state of the third environment state by adding the timestep to a second value of the asset state of the second environment state.

12. A device comprising:
a non-transitory memory; and
one or more processors to:
obtain a first environment state, associated with a first environment time, of an environment, wherein the first environment state indicates inclusion in the environment of one or more assets and further indicates one or more states of the one or more assets;
determine, according to a first model and based on the first environment state, a second environment state associated with a second environment time;
receive an input indicative of a timestep from the second environment time to a third environment time, wherein the timestep is different than a difference between the first environment time and the second environment time;
determine, according to a second model, different than the first model, and based on the second environment state, a third environment state associated with the third environment time.

13. The device of claim 12 , wherein the one or more processors are to receive the input indicative of the timestep by receiving user input indicative of a selection of one of a plurality of timescale affordances respectively associated with a plurality of timesteps.

14. The device of claim 12 , wherein the second model is more computationally efficient than the first model.

15. The device of claim 12 , wherein:
the one or more processors are to determine, in accordance with the first model, the second environment state by determining a second value of an asset state of the second environment state based on a first value of the asset state of the first environment state; and
the one or more processors are to determine, in accordance with the second model, the third environment state by determining a third value of the asset state of the third environment state independent of the second value of the asset state of the second environment state.

16. The device of claim 12 , wherein:
the one or more processors are to determine, in accordance with the first model, the second environment state by determining a second value of an asset state of the second environment state based on the first environment state; and
the one or more processors are to determine, in accordance with the second model, the third environment state by forgoing determining a third value of the asset state of the third environment state based on the second environment state.

17. The device of claim 12 , wherein:
the one or more processors are to determine, in accordance with the first model, the second environment state by determining a second value of an asset state of the second environment state based on a first value of the asset state of the first environment state; and
the one or more processors are to determine, in accordance with the second model, the third environment state by excluding the asset having the asset state from the third environment state.

18. The device of claim 17 , wherein the one or more processors are to determine, in accordance with the second model, the third environment state by including one or more new assets having the same asset type as the asset having the asset state based on a number of assets having a respective asset type in the second environment state.

19. The device of claim 12 , wherein the one or more processors are to determine, in accordance with the second model, the third environment state by determining a third value of an asset state of the third environment state by adding the

Assignees

• Apple Inc

Inventors

• MORGAN Bo
• Drummond Mark E
• Meier Peter
• Dunn Cameron J
• Russell John Christopher
• Sivapurapu Siva Chandra Mouli
• Richter Ian M

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• A63F2300/60

  Methods for processing data by generating or executing the game program · CPC title

• G06F40/14

  Tree-structured documents (parsing G06F40/205; validation G06F40/226) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• A63F13/55

  Controlling game characters or game objects based on the game progress · CPC title