Method and device for resolving focal conflict

Patent metadata

Field	Value
Publication number	US-12033240-B2
Application number	US-202016909620-A
Country	US
Kind code	B2
Filing date	Jun 23, 2020
Priority date	Sep 27, 2019
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

In one implementation, a method of resolving focal conflict in a computer-generated reality (CGR) environment is performed by a device including a processor, non-transitory memory, an image sensor, and a display. The method includes capturing, using the image sensor, an image of a scene including a real object in a particular direction at a first distance from the device. The method includes displaying, on the display, a CGR environment including a virtual object in the particular direction at a second distance from the device. In accordance with a determination that the second distance is less than the first distance, the CGR environment includes the virtual object overlaid on the scene. In accordance with a determination that the second distance is greater than the first distance, the CGR environment includes the virtual object with an obfuscation area that obfuscates at least a portion of the real object within the obfuscation area.

First claim

What is claimed is:

1. A method comprising:
at a device including one or more processors, an image sensor, non-transitory memory, and a display:
capturing, using the image sensor, an image of a scene including a real object; and
displaying, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;
wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and
wherein, in accordance with a determination that the virtual object has moved through the real object further from the device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

2. The method of claim 1 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

3. The method of claim 1 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

4. The method of claim 1 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

5. The method of claim 1 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

6. The method of claim 5 , wherein the virtual world includes a virtual floor.

7. The method of claim 6 , wherein the virtual floor is coplanar with a real floor of the scene.

8. The method of claim 6 , further comprising displaying a virtual shadow of the virtual object on the virtual floor.

9. The method of claim 1 , wherein the obfuscation area occupies the entire display except for the virtual object.

10. The method of claim 1 , wherein displaying the CGR environment includes displaying, on the display, a representation of the scene.

11. An electronic device comprising:
an image sensor;
a display;
a non-transitory memory; and
one or more processors to:
capture, using the image sensor, an image of a scene including a real object; and
display, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;
wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and
wherein, in accordance with a determination that the virtual object has moved through the real object further from then device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

12. The method of claim 1 , wherein the virtual object represents a real object remote from CGR environment that correspondingly moves in the CGR environment when the real object remote from the CGR environment moves.

13. The method of claim 12 , wherein the real object remote from the CGR environment is a person and the virtual object is an avatar.

14. The electronic device of claim 11 , wherein the obfuscation area includes a blurring region that blurs the portion of the real object within the blurring region.

15. The electronic device of claim 11 , wherein the obfuscation area includes a dimming region that dims the portion of the real object within the dimming region.

16. The electronic device of claim 11 , wherein the obfuscation area includes a masking region that occludes the portion of the real object within the masking region.

17. The electronic device of claim 11 , wherein the obfuscation area includes a portal region that displays a virtual world over the portion of the real object within the portal region.

18. The electronic device of claim 17 , wherein the virtual world includes a virtual floor that is coplanar with a real floor of the scene.

19. The electronic device of claim 11 , wherein the obfuscation area occupies the entire display except for the virtual object.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an image sensor and a display cause the device to:
capture, using the image sensor, an image of a scene including a real object; and
display, on the display, a computer-generated reality (CGR) environment including a virtual object moving through the real object from a first location in the CGR environment closer to the device than the real object to a second location in the CGR environment further from the device than the real object;
wherein, in accordance with a determination that the virtual object has not moved through the real object further from the device than the real object, the CGR environment includes the virtual object overlaid on the scene; and
wherein, in accordance with a determination that the virtual object has moved through the real object further from then device than the real object, the CGR environment includes the virtual object with an obfuscation area surrounding the virtual object that obfuscates at least a portion of the real object within the obfuscation area.

Assignees

• Apple Inc

Inventors

• Palangie Alexis Henri
• Chiu Shih Sang
• Sommer Bruno M
• Smith Connor Alexander
• Burns Aaron Mackay

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T5/70 Primary

  Denoising; Smoothing · CPC title

• G06T5/20

  using local operators · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title