Method and devices for presenting and manipulating conditionally dependent synthesized reality content threads

Patent metadata

Field	Value
Publication number	US-12033290-B2
Application number	US-202318233867-A
Country	US
Kind code	B2
Filing date	Aug 14, 2023
Priority date	Feb 19, 2018
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

First claim

What is claimed is:

1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices:
instantiating a first objective-effectuator (OE) associated with a first set of attributes and a second OE associated with a second set of attributes into a synthesized reality (SR) setting, wherein the first set of attributes includes first contextual information associated with a current state of the first OE, and wherein the second set of attributes includes second contextual information associated with a current state of the second OE;
generating a first objective for the first OE based on the first set of attributes for the first OE and the second set of attributes for the second OE, wherein the first objective is consistent with the first and second contextual information;
generating a second objective for the second OE based on the second set of attributes for the second OE, wherein the second objective is different from the first objective, and wherein the first and second objectives are associated with a first time period between a first temporal point and a second temporal point;
generating a first set of actions associated with the first time period for the first OE based on the first objective;
generating a second set of actions associated with the first time period for the second OE based on the second objective; and
rendering for display the SR setting including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

2. The method of claim 1 , further comprising:
instantiating a third OE associated with a third set of attributes into the SR setting for a second time period, wherein the first OE is encapsulated within the second and third OEs; and
updating the first objective for first OE for the second time period based on the first and second sets of attributes and also the third set of attributes associated with the third OE.

3. The method of claim 1 , further comprising:
removing the second OE from the SR setting for a second time period; and
updating the first objective for first OE for the second time period based on the first set of attributes.

4. The method of claim 1 , further comprising:
instantiating a third OE associated with a third set of attributes and a fourth OE associated with a fourth set of attributes into the SR setting, wherein the third OE is encapsulated within the fourth OE.

5. The method of claim 4 , wherein the first and second OEs are associated with a first OE grouping, and wherein the third and fourth OEs are associated with a second OE grouping.

6. The method of claim 5 , wherein at least one OE is included in both the first and second OE groupings.

7. The method of claim 1 , wherein generating the second set of actions includes generating the second set of actions associated with the first time period for the second OE based on a self-preservation objective instead of the second objective if a predetermined criterion is satisfied.

8. The method of claim 1 , further comprising:
obtaining contextual information characterizing the SR setting, wherein the contextual information includes information associated with OEs instantiated within the SR setting.

9. The method of claim 8 , wherein the contextual information includes information associated with user-specified information associated with the SR setting.

10. The method of claim 1 , further comprising:
setting virtual environmental conditions for the SR setting, wherein the virtual environmental conditions are set based on source assets characterizing a scene.

11. The method of claim 10 , further comprising:
receiving a user input modifying the virtual environmental conditions for the SR setting for a second time period; and
in response to receiving the user input, modifying the virtual environmental conditions for the SR setting based on the user input for the second time period.

12. A computing system comprising:
one or more processors;
a non-transitory memory;
an interface for communicating with a display device and one or more input devices; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the computing system to:
instantiate a first objective-effectuator (OE) associated with a first set of attributes and a second OE associated with a second set of attributes into a synthesized reality (SR) setting, wherein the first set of attributes includes first contextual information associated with a current state of the first OE, and wherein the second set of attributes includes second contextual information associated with a current state of the second OE;
generate a first objective for the first OE based on the first set of attributes for the first OE and the second set of attributes for the second OE, wherein the first objective is consistent with the first and second contextual information;
generate a second objective for the second OE based on the second set of attributes for the second OE, wherein the second objective is different from the first objective, and wherein the first and second objectives are associated with a first time period between a first temporal point and a second temporal point;
generate a first set of actions associated with the first time period for the first OE based on the first objective;
generate second set of actions associated with the first time period for the second OE based on the second objective; and
render for display the SR setting including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

13. The computing system of claim 12 , wherein the one or more programs further cause the computing system to:
instantiate a third OE associated with a third set of attributes into the SR setting for a second time period, wherein the first OE is encapsulated within the second and third OEs; and
update the first objective for first OE for the second time period based on the first and second sets of attributes and also the third set of attributes associated with the third OE.

14. The computing system of claim 12 , wherein the one or more programs further cause the computing system to:
remove the second OE from the SR setting for a second time period; and
update the first objective for first OE for the second time period based on the first set of attributes.

15. The computing system of claim 12 , wherein the one or more programs further cause the computing system to:
instantiate a third OE associated with a third set of attributes and a fourth OE associated with a fourth set of attributes into the SR setting, wherein the third OE is encapsulated within the fourth OE.

16. The computing system of claim 15 , wherein the first and second OEs are associated with a first OE grouping, and wherein the third and fourth OEs are associated with a second OE grouping.

17. The computing system of claim 16 , wherein at least one OE is included in both the first and second OE groupings.

18. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a computing system with an interface for communicating with a display device and one or more input devices, cause the computing system to:
instantiate a first objective-effectuator (OE) associated with a first set of attributes and a second OE associated with a second set of attributes into a synthesized reality (SR) sett

Assignees

• Apple Inc

Inventors

• Richter Ian M
• Rockwell Michael J
• Saini Amritpal Singh
• Soares Olivier

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/092

  Reinforcement learning · CPC title

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• G06N3/006 Primary

  based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title