Occlusion detection system

Patent metadata

Field	Value
Publication number	US-11687150-B2
Application number	US-202117361857-A
Country	US
Kind code	B2
Filing date	Jun 29, 2021
Priority date	Sep 10, 2019
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

First claim

What is claimed is:

1. A method comprising:
accessing first image data from a first client device, the first image data comprising a first display of an object;
detecting a first attribute of the object based on the first image data;
accessing second image data from a second client device, the second image data comprising a second display of the object;
detecting a second attribute of the object based on the second image data;
performing a comparison of the first attribute and the second attribute;
detecting an occlusion based on the comparison the occlusion comprising a semantic feature; and
causing display of media content based on the semantic feature of the occlusion.

2. The method of claim 1 , wherein the first attribute and the second attribute comprise pixel color values.

3. The method of claim 1 , wherein the detecting the first attribute of the object based on the first image data further comprises:
determining a location of the client device;
accessing a repository based on the location of the client device;
identifying the object based on the accessing the repository based on the location of the client device; and
detecting the first attribute based on the identifying the object.

4. The method of claim 1 , wherein the method further comprises:
causing display of the media content based on the semantic feature and a position of the occlusion.

5. The method of claim 1 , wherein the media content comprises augmented-reality content.

6. The method of claim 1 , wherein the first attribute and the second attribute comprise semantic features.

7. The method of claim 1 , wherein the method further comprises:
determining a location of the first client device;
accessing a repository based on the location of the first client device; and
updating a record associated with the object within the repository based on the first attribute.

8. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
accessing first image data from a first client device, the first image data comprising a first display of an object;
detecting a first attribute of the object based on the first image data;
accessing second image data from a second client device, the second image data comprising a second display of the object;
detecting a second attribute of the object based on the second image data;
performing a comparison of the first attribute and the second attribute;
detecting an occlusion based on the comparison the occlusion comprising a semantic feature; and
causing display of media content based on the semantic feature of the occlusion.

9. The system of claim 8 , wherein the first attribute and the second attribute comprise pixel color values.

10. The system of claim 8 , wherein the detecting the first attribute of the object based on the first image data further comprises:
determining a location of the client device;
accessing a repository based on the location of the client device;
identifying the object based on the accessing the repository based on the location of the client device; and
detecting the first attribute based on the identifying the object.

11. The system of claim 8 , wherein the operations further comprise:
causing display of the media content based on a position of the occlusion.

12. The system of claim 8 , wherein the media content comprises augmented-reality content.

13. The system of claim 8 , wherein the first attribute and the second attribute comprise semantic features.

14. The system of claim 8 , wherein the operations further comprise:
determining a location of the first client device;
accessing a repository based on the location of the first client device; and
updating a record associated with the object within the repository based on the first attribute.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing first image data from a first client device, the first image data comprising a first display of an object;
detecting a first attribute of the object based on the first image data;
accessing second image data from a second client device, the second image data comprising a second display of the object;
detecting a second attribute of the object based on the second image data;
performing a comparison of the first attribute and the second attribute;
detecting an occlusion based on the comparison the occlusion comprising a semantic feature; and
causing display of media content based on the semantic feature of the occlusion.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the first attribute and the second attribute comprise pixel color values.

17. The non-transitory machine-readable storage medium of claim 15 , wherein the detecting the first attribute of the object based on the first image data further comprises:
determining a location of the client device;
accessing a repository based on the location of the client device;
identifying the object based on the accessing the repository based on the location of the client device; and
detecting the first attribute based on the identifying the object.

18. The non-transitory machine-readable storage medium of claim 15 , wherein the operations further comprise:
causing display of the media content based on a position of e occlusion.

19. The non-transitory machine-readable storage medium of claim 15 , wherein the media content comprises augmented-reality content.

20. The non-transitory machine-readable storage medium of claim 15 , wherein the first attribute and the second attribute comprise semantic features.

Assignees

• Snap Inc

Inventors

• Cowburn Piers
• Li David
• Müller Sandvik Isac Andreas
• Pan Qi

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06V10/40

  Extraction of image or video features · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04L51/222

  using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area · CPC title