Generating directives for objective-effectuators

Patent metadata

Field	Value
Publication number	US-11436813-B2
Application number	US-202117325454-A
Country	US
Kind code	B2
Filing date	May 20, 2021
Priority date	May 6, 2019
Publication date	Sep 6, 2022
Grant date	Sep 6, 2022

Abstract

A method includes generating, in coordination with an emergent content engine, a first objective for a first objective-effectuator and a second objective for a second objective-effectuator instantiated in a computer-generated reality (CGR) environment. The first and second objectives are associated with a mutual plan. The method includes generating, based on characteristic values associated with the first and second objective-effectuators a first directive for the first objective-effectuator and a second directive for the second objective-effectuator. The first directive limits actions generated by the first objective-effectuator over a first set of time frames associated with the first objective and the second directive limits actions generated by the second objective-effectuator over a second set of time frames associated with the second objective. The method includes displaying manipulations of CGR representations of the first and second objective-effectuators in the CGR environment in accordance with the first and second directives.

First claim

What is claimed is:

1. A method comprising:
at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory:
obtaining a first objective for a first object and a second objective for a second object that are in an environment, wherein the first and second objectives are associated with a mutual plan;
generating, based on characteristic values associated with the first and second objects, a first directive for the first object and a second directive for the second object, wherein the first directive limits actions performed by the first object over a first set of one or more time frames associated with the first objective and the second directive limits actions performed by the second object over a second set of one or more time frames associated with the second objective; and
displaying manipulations of the first and second objects in the environment in accordance with the first and second directives.

2. The method of claim 1 , wherein the first directive includes a first set of boundary conditions for the first objective, and the second directive includes a second set of boundary conditions for the second objective.

3. The method of claim 1 , wherein the first directive includes a first objective characterization vector that characterizes the first objective in order to limit a scope of the first objective, and the second directive includes a second objective characterization vector that characterizes the second objective in order to limit a scope of the second objective.

4. The method of claim 1 , wherein the first directive indicates how to satisfy the first objective, and the second directive indicates how to satisfy the second objective.

5. The method of claim 1 , wherein the first directive indicates a first time for satisfying the first objective, and the second directive indicates a second time for satisfying the second objective.

6. The method of claim 1 , wherein the first directive indicates a first location within the environment for satisfying the first objective, and the second directive indicates a second location within the environment for satisfying the second objective.

7. The method of claim 1 , wherein the first directive indicates a first bounded set of actions to satisfy the first objective, and the second directive indicates a second bounded set of actions to satisfy the second objective.

8. The method of claim 1 , further comprising:
modifying environmental settings of the environment in order to trigger the first and second objects to satisfy the first and second objectives in accordance with the first and second directives.

9. The method of claim 1 , further comprising:
determining whether the first objective breaches the mutual plan; and
in response to determining that the first objective breaches the mutual plan, generating the first directive to modify the first objective.

10. The method of claim 9 , wherein modifying the first objective includes blocking the first objective, demoting the first objective, or dampening the first objective.

11. The method of claim 1 , wherein the first directive indicates a first target behavior for the first object while advancing towards the first objective, and the second directive indicates a second target behavior for the second object while advancing towards the second objective.

12. The method of claim 1 , wherein the first directive indicates a first permissible set of actions for the first object, and the second directive indicates a second permissible set of actions for the second object.

13. The method of claim 1 , further comprising:
modifying an environmental setting of the environment in order to trigger a change in actions of the first and second objects.

14. The method of claim 1 , wherein the first directive modifies the first objective in order to satisfy the mutual plan.

15. The method of claim 1 , wherein the first directive modifies the first objective in order to intertwine the first objective with the second objective.

16. The method of claim 1 , further comprising:
providing the first directive as an input to a first engine that generates actions for the first object; and
providing the second directive as an input to a second engine that generates actions for the second object.

17. The method of claim 1 , wherein displaying the manipulations includes displaying the first and second objects performing actions in accordance with the first and second directives.

18. The method of claim 1 , wherein the first objective includes a plurality of objectives, and the first directive orders the plurality of objectives into a sequence that satisfies the mutual plan.

19. A device comprising:
one or more processors;
a non-transitory memory;
one or more displays; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:
obtain a first objective for a first object and a second objective for a second object that are in an environment, wherein the first and second objectives are associated with a mutual plan;
generate, based on characteristic values associated with the first and second objects, a first directive for the first object and a second directive for the second object, wherein the first directive limits actions performed by the first object over a first set of one or more time frames associated with the first objective and the second directive limits actions performed by the second object over a second set of one or more time frames associated with the second objective; and
display manipulations of the first and second objects in the environment in accordance with the first and second directives.

20. The device of claim 19 , wherein the first directive includes a first set of boundary conditions for the first objective, and the second directive includes a second set of boundary conditions for the second objective.

21. The device of claim 19 , wherein the first directive indicates a first time for satisfying the first objective, and the second directive indicates a second time for satisfying the second objective.

22. The device of claim 19 , wherein the one or more programs further cause the device to:
determine whether the first objective breaches the mutual plan; and
in response to determining that the first objective breaches the mutual plan, generate the first directive to modify the first objective.

23. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with a display, cause the device to:
obtain a first objective for a first object and a second objective for a second object that are in an environment, wherein the first and second objectives are associated with a mutual plan;
generate, based on characteristic values associated with the first and second objects, a first directive for the first object and a second directive for the second object, wherein the first directive limits actions performed by the first object over a first set of one or more time frames associated with the first objective and the second directive limits actions performed by the second object over a second set of one or more time frames associated with the second objective; and
display manipulations of the first and second objects in the environment in accordance with the first and second directives.

24. The non-transitory memory of claim 23 , wherein the first directive inclu

Assignees

• Apple Inc

Inventors

• Drummond Mark
• Sivapurapu Siva Chandra Mouli
• MORGAN Bo

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title