Occlusion detection system

Patent metadata

Field	Value
Publication number	US-12379772-B2
Application number	US-202418625982-A
Country	US
Kind code	B2
Filing date	Apr 3, 2024
Priority date	Sep 10, 2019
Publication date	Aug 5, 2025
Grant date	Aug 5, 2025

Abstract

An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

First claim

What is claimed is:

1. A method comprising:
accessing image data from a client device, the image data comprising a set of image features that depict a display of an object;
accessing a repository that includes a set of expected properties associated with the object;
detecting an occlusion based on the set of expected properties associated with the object;
determining an attribute of the occlusion, the attribute including a semantic feature; and
causing display of media content at a position within the image data based on the semantic feature associated with the occlusion.

2. The method of claim 1 , wherein the detecting the occlusion based on the set of image features includes:
performing a comparison of the set of image features with a set of expected properties associated with the object; and
detecting the occlusion based on the comparison.

3. The method of claim 2 , wherein the set of expected properties include pixel color values.

4. The method of claim 1 , wherein the semantic feature includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

5. The method of claim 1 , wherein the media content comprises augmented-reality content.

6. The method of claim 1 , further comprising:
determining a location of the client device; and
identifying the object based on the location of the client device.

7. The method of claim 6 , wherein the determining the location of the client device includes detecting the client device within a geo-fence.

8. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
accessing image data from a client device, the image data comprising a set of image features that depict a display of an object;
accessing a repository that includes a set of expected properties associated with the object;
detecting an occlusion based on the set of expected properties associated with the object;
determining an attribute of the occlusion, the attribute including a semantic feature; and
causing display of media content at a position within the image data based on the semantic feature associated with the occlusion.

9. The system of claim 8 , wherein the detecting the occlusion based on the set of image features includes:
performing a comparison of the set of image features with a set of expected properties associated with the object; and
detecting the occlusion based on the comparison.

10. The system of claim 9 , wherein the set of expected properties include pixel color values.

11. The system of claim 8 , wherein the semantic feature includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

12. The system of claim 8 , wherein the media content comprises augmented-reality content.

13. The system of claim 8 , further comprising:
determining a location of the client device; and
identifying the object based on the location of the client device.

14. The system of claim 13 , wherein the determining the location of the client device includes detecting the client device within a geo-fence.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing image data from a client device, the image data comprising a set of image features that depict a display of an object;
accessing a repository that includes a set of expected properties associated with the object;
detecting an occlusion based on the set of expected properties associated with the object;
determining an attribute of the occlusion, the attribute including a semantic feature; and
causing display of media content at a position within the image data based on the semantic feature associated with the occlusion.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the detecting the occlusion based on the set of image features includes:
performing a comparison of the set of image features with a set of expected properties associated with the object; and
detecting the occlusion based on the comparison.

17. The non-transitory machine-readable storage medium of claim 16 , wherein the set of expected properties include pixel color values.

18. The non-transitory machine-readable storage medium of claim 15 , wherein the semantic feature includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

19. The non-transitory machine-readable storage medium of claim 15 , wherein the media content comprises augmented-reality content.

20. The non-transitory machine-readable storage medium of claim 15 , further comprising:
determining a location of the client device; and
identifying the object based on the location of the client device.

Assignees

• Snap Inc

Inventors

• Cowburn Piers George
• Li David
• Müller Sandvik Isac Andreas
• Pan Qi

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• G06V10/40

  Extraction of image or video features · CPC title

• H04L51/222

  using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area · CPC title

• H04W4/021

  Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title