Shared augmented reality system

Patent metadata

Field	Value
Publication number	US-11776256-B2
Application number	US-202217584946-A
Country	US
Kind code	B2
Filing date	Jan 26, 2022
Priority date	Mar 27, 2020
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

First claim

What is claimed is:

1. A method comprising:
detecting a client device within a geo-fence that encompasses a location of interest, the client device associated with a user profile;
assigning a graphical property to the user profile responsive to the detecting the client device within the geo-fence, the graphical property corresponding with the location of interest;
causing display of a presentation of image data at the client device, the image data comprising a set of image features that define a surface of an object depicted by the image data;
receiving an input that selects the object from the presentation of the image data at the client device; and
applying the graphical property assigned to the user profile to at least a portion of the surface of the object.

2. The method of claim 1 , wherein the input that selects the object from the presentation of the image data includes a tactile input at a position that corresponds with a display of the object within a graphical user interface of the client device.

3. The method of claim 1 , wherein the graphical property includes one or more of a color and a pattern.

4. The method of claim 1 , wherein the applying the graphical property from the user profile of the user to the portion of the surface of the object includes:
causing display of the portion of the surface of the object based on the graphical property.

5. The method of claim 1 , wherein the receiving the input that selects the object from the presentation of the image data further comprises:
receiving a tactile input at the client device;
causing display of a projection that extends from a position of the client device within the presentation of the image data, the projection comprising a trajectory; and
selecting the object based on the trajectory of the projection.

6. The method of claim 5 , wherein the causing display of the projection includes determining a heading of the client device, and wherein the trajectory is based on the heading.

7. The method of claim 1 , wherein the method further comprises:
determining an area of the portion of the surface of the object; and
generating a value based on the area.

8. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
detecting a client device within a geo-fence that encompasses a location of interest, the client device associated with a user profile;
assigning a graphical property to the user profile responsive to the detecting the client device within the geo-fence, the graphical property corresponding with the location of interest;
causing display of a presentation of image data at the client device, the image data comprising a set of image features that define a surface of an object depicted by the image data;
receiving an input that selects the object from the presentation of the image data at the client device; and
applying the graphical property assigned to the user profile to at least a portion of the surface of the object.

9. The system of claim 8 , wherein the input that selects the object from the presentation of the image data includes a tactile input at a position that corresponds with a display of the object within a graphical user interface of the client device.

10. The system of claim 8 , wherein the graphical property includes one or more of a color and a pattern.

11. The system of claim 8 , wherein the applying the graphical property from the user profile of the user to the portion of the surface of the object includes:
causing display of the portion of the surface of the object based on the graphical property.

12. The system of claim 8 , wherein the receiving the input that selects the object from the presentation of the image data further comprises:
receiving a tactile input at the client device;
causing display of a projection that extends from a position of the client device within the presentation of the image data, the projection comprising a trajectory; and
selecting the object based on the trajectory of the projection.

13. The system of claim 12 , wherein the causing display of the projection includes determining a heading of the client device, and wherein the trajectory is based on the heading.

14. The system of claim 8 , wherein the operations further comprise:
determining an area of the portion of the surface of the object; and
generating a value based on the area.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
detecting a client device within a geo-fence that encompasses a location of interest, the client device associated with a user profile;
assigning a graphical property to the user profile responsive to the detecting the client device within the geo-fence, the graphical property corresponding with the location of interest;
causing display of a presentation of image data at the client device, the image data comprising a set of image features that define a surface of an object depicted by the image data;
receiving an input that selects the object from the presentation of the image data at the client device; and
applying the graphical property assigned to the user profile to at least a portion of the surface of the object.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the input that selects the object from the presentation of the image data includes a tactile input at a position that corresponds with a display of the object within a graphical user interface of the client device.

17. The non-transitory machine-readable storage medium of claim 15 , wherein the graphical property includes one or more of a color and a pattern.

18. The non-transitory machine-readable storage medium of claim 15 , wherein the applying the graphical property from the user profile of the user to the portion of the surface of the object includes:
causing display of the portion of the surface of the object based on the graphical property.

19. The non-transitory machine-readable storage medium of claim 15 , wherein the receiving the input that selects the object from the presentation of the image data further comprises:
receiving a tactile input at the client device;
causing display of a projection that extends from a position of the client device within the presentation of the image data, the projection comprising a trajectory; and
selecting the object based on the trajectory of the projection.

20. The non-transitory machine-readable storage medium of claim 19 , wherein the causing display of the projection includes determining a heading of the client device, and wherein the trajectory is based on the heading.

Assignees

• Snap Inc

Inventors

• Li David
• Müller Sandvik Isac Andreas
• Pan Qi
• Boroujerdi Rastan
• Hong Kevin Yimeng
• Deng Peng
• Cowburn Piers George
• Tang Jonathan
• Wei Junjie

Classifications

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T7/74

  involving reference images or patches · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G09G3/003

  to produce spatial visual effects · CPC title