Muting mode for a virtual object representing one or more physical elements

Patent metadata

Field	Value
Publication number	US-11947733-B2
Application number	US-202117362457-A
Country	US
Kind code	B2
Filing date	Jun 29, 2021
Priority date	Apr 15, 2019
Publication date	Apr 2, 2024
Grant date	Apr 2, 2024

Abstract

Techniques for displaying a virtual object in an enhanced reality setting in accordance with a physical muting mode being active are described. In some examples, a system obtains context data for one or more physical elements in a physical setting, wherein the context data includes first context data and second context data that is different from the first context data. In some examples, in response to obtaining the context data for the one or more physical elements in the physical setting, a system causes display of a virtual object that represents the one or more physical elements using the first context data without using the second context data, in accordance with a determination that a physical muting mode is active.

First claim

What is claimed is:

1. A system, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
detecting a gaze direction of a user;
in accordance with at least a determination that the gaze direction of the user is directed at a predetermined location, activating a physical muting mode; and
while the physical muting mode is activated:
obtaining a first set of context data for one or more physical elements in a physical setting, wherein the first set of context data includes first context data and second context data that is different from the first context data; and
in response to obtaining the first set of context data for the one or more physical elements in the physical setting, causing display of a virtual object that represents the one or more physical elements using the first context data without using the second context data.

2. The system of claim 1 , wherein causing the display of the virtual object includes transmitting the first context data without transmitting the second context data.

3. The system of claim 1 , wherein causing the display of the virtual object includes transmitting at least a portion of the first set of context data, wherein the first set of context data is configured to result in display of the virtual object based on at least the portion of the first set of context data.

4. The system of claim 1 , wherein the one or more programs further include instructions for:
while the physical muting mode is activated, receiving a user input corresponding to a request to deactivate the physical muting mode;
in response to receiving the user input corresponding to the request to deactivate the physical muting mode, deactivating the physical muting mode; and
while the physical muting mode is not active:
obtaining a second set of context data for the one or more physical elements in the physical setting, wherein the second set of context data includes third context data and fourth context data that is different from the third context data; and
in response to obtaining the second set of context data for the one or more physical elements in the physical setting, causing display of the virtual object that represents the one or more physical elements using the third context data and the fourth context data.

5. The system of claim 1 , wherein the obtained first set of context data includes sensor data representing movement of the one or more physical elements in the physical setting.

6. The system of claim 1 , wherein causing display of the virtual object that represents the one or more physical elements using the first context data without using the second context data includes:
identifying a portion of the obtained first set of context data; and
causing display of the virtual object that represents the one or more physical elements without the identified portion of the obtained first set of context data.

7. The system of claim 6 , wherein the portion of the obtained first set of context data is identified automatically based on a match between the portion of the obtained first set of context data and predefined user data.

8. The system of claim 1 , wherein causing display of the virtual object that represents the one or more physical elements using the first context data without using the second context data includes causing display of an animation.

9. The system of claim 8 , wherein the animation corresponds to a portion of the virtual object that represents the one or more physical elements.

10. The system of claim 1 , wherein the one or more programs further include instructions for:
further in response to obtaining the first set of context data for the one or more physical elements in the physical setting and in accordance with a determination that an absence mode is active, causing display of the virtual object that represents the one or more physical elements without using the first context data and the second context data.

11. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors, the one or more programs including instructions for:
detecting a gaze direction of a user;
in accordance with at least a determination that the gaze direction of the user is directed at a predetermined location, activating a physical muting mode; and
while the physical muting mode is activated:
obtaining a first set of context data for one or more physical elements in a physical setting, wherein the first set of context data includes first context data and second context data that is different from the first context data; and
in response to obtaining the first set of context data for the one or more physical elements in the physical setting, causing display of a virtual object that represents the one or more physical elements using the first context data without using the second context data.

12. The non-transitory computer-readable storage medium of claim 11 , wherein causing the display of the virtual object includes transmitting the first context data without transmitting the second context data.

13. The non-transitory computer-readable storage medium of claim 11 , wherein causing the display of the virtual object includes transmitting at least a portion of the first set of context data, wherein the first set of context data is configured to result in display of the virtual object based on at least the portion of the first set of context data.

14. The non-transitory computer-readable storage medium of claim 11 , wherein the one or more programs further include instructions for:
while the physical muting mode is activated, receiving a user input corresponding to a request to deactivate the physical muting mode;
in response to receiving the user input corresponding to the request to deactivate the physical muting mode, deactivating the physical muting mode; and
while the physical muting mode is not active:
obtaining a second set of context data for the one or more physical elements in the physical setting, wherein the second set of context data includes third context data and fourth context data that is different from the third context data; and
in response to obtaining the second set of context data for the one or more physical elements in the physical setting, causing display of the virtual object that represents the one or more physical elements using the third context data and the fourth context data.

15. A method, comprising:
detecting a gaze direction of a user;
in accordance with at least a determination that the gaze direction of the user is directed at a predetermined location, activating a physical muting mode; and
while the physical muting mode is activated:
obtaining a first set of context data for one or more physical elements in a physical setting, wherein the first set of context data includes first context data and second context data that is different from the first context data; and
in response to obtaining the first set of context data for the one or more physical elements in the physical setting, causing display of a virtual object that represents the one or more physical elements using the first context data without using the second context data.

16. The method of claim 15 , further comprising:
while the physical muting mode is activated, receiving a user input corresponding to a request to deactivate the physical muting mode;
in response to receiving the user input corresponding to the request to deactivate the physical muting mode, de

Assignees

• Apple Inc

Inventors

• Boissière Clément Pierre Nicolas
• Budhram Shaun
• Morgan Tucker Bull
• Sommer Bruno M
• Smith Connor A

Classifications

• G06F3/03 Primary

  Arrangements for converting the position or the displacement of a member into a coded form · CPC title

• G06T13/20

  Three-dimensional [3D] animation · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title