Coded vision system

Patent metadata

Field	Value
Publication number	US-11989809-B2
Application number	US-202218146878-A
Country	US
Kind code	B2
Filing date	Dec 27, 2022
Priority date	Jan 16, 2017
Publication date	May 21, 2024
Grant date	May 21, 2024

Abstract

A system and method for presentation of computer vision (e.g., augmented reality, virtual reality) using user data and a user code is disclosed. A client device can detect an image feature (e.g., scannable code) in one or more images. The image feature is determined to be linked to a user account. User data from the user account can then be used to generate one or more augmented reality display elements that can be anchored to the image feature in the one or more images.

First claim

What is claimed is:

1. A method comprising:
identifying an image feature in a live feed from an image sensor of a device of a second user;
identifying a first user based on the image feature, the image feature being an identifier of a first user account on a social network application, the first user account belonging to the first user;
accessing image post data of the first user, the image post data comprising a plurality of images from ephemeral messages published by the first user account on the social network application; and
generating an animation sequence of a plurality of virtual objects emanating from the image feature, each virtual object populated with one of the plurality of images.

2. The method of claim 1 , further comprising:
displaying, in a display of the device, the animation sequence as an overlay to the live feed from the image sensor of the device.

3. The method of claim 2 , wherein the animation sequence is anchored to the image feature in the live feed.

4. The method of claim 3 , wherein the animation sequence depicts a plurality of bubbles as emanating from the image feature, wherein each bubble is populated with one of the plurality of images.

5. The method of claim 1 , further comprising:
generating an add button overlay to the live feed, the add button overlay appearing anchored to the image feature in the live feed,
wherein the add button overlay, when selected, is configured to connect the first user account with a second user account on the social network application, the second user account belonging to the second user.

6. The method of claim 5 , further comprising:
detecting a selection of the add button overlay by the second user at the device;
in response to detecting the selection of the add button overlay by the second user at the device, determining whether the first user account includes avatar data of the first user;
in response determining that the first user account includes avatar data of the first user, accessing, from a server of the social network application, the avatar data of the first user and avatar data of the second user;
generating a combined avatar that displays the avatar data of the first user with avatar data of the second user; and
displaying, on the device, the combined avatar overlaid on the image feature in the live feed, the combined avatar being anchored to the image feature.

7. The method of claim 6 , wherein the combined avatar is generated from a combined avatar template that arranges the avatar data of the first user and the avatar data of the second user into a predefined configuration.

8. The method of claim 6 , further comprising:
generating an electronic message for transmission to the first user account, the electronic message comprising the combined avatar; and
transmitting, to the second user account, the electronic message comprising the combined avatar.

9. The method of claim 8 , wherein the electronic message is an ephemeral message that automatically expires after a specified time duration such that the ephemeral message is no longer accessible through the social network application after expiration.

10. The method of claim 1 , further comprising:
determining whether the first user account of the first user and a second user account of the second user are connected as friends on the social network application;
in response to determining that the first user account and the second user account are connected as friends on the social network application, accessing avatar data of the first user and avatar data of the second user;
generating a combined avatar that displays the avatar data of the first user with avatar data of the second user; and
displaying, on the device of the second user, the combined avatar overlaid on the image feature in the live feed, the combined avatar being anchored to the image feature.

11. A device comprising:
one or more processors;
a display; and
a memory storing instructions that, when executed by the one or more processors, cause the device to perform operations comprising:
identifying an image feature in a live feed from an image sensor of a device of a second user;
identifying a first user based on the image feature, the image feature being an identifier of a first user account on a social network application, the first user account belonging to a first user;
accessing image post data of the first user, the image post data comprising a plurality of images from ephemeral messages published by the first user account on the social network application; and
generating an animation sequence of a plurality of virtual objects emanating from the image feature, each virtual object populated with one of the plurality of images.

12. The device of claim 11 , wherein the operations further comprise:
displaying, in the display of the device, the animation sequence as an overlay to the live feed from the image sensor of the device.

13. The device of claim 12 , wherein the animation sequence is anchored to the image feature in the live feed.

14. The device of claim 13 , wherein the animation sequence depicts a plurality of bubbles as emanating from the image feature, wherein each bubble is populated with one of the plurality of images.

15. The device of claim 11 , wherein the operations further comprise:
generating an add button overlay to the live feed, the add button overlay appearing anchored to the image feature in the live feed,
wherein the add button overlay, when selected, is configured to connect the first user account with a second user account on the social network application, the second user account belonging to the second user.

16. The device of claim 15 , wherein the operations further comprise:
detecting a selection of the add button overlay by the second user at the device;
in response to detecting the selection of the add button overlay by the second user at the device, determining whether the first user account includes avatar data of the first user;
in response determining that the first user account includes avatar data of the first user, accessing, from a server of the social network application, the avatar data of the first user;
accessing avatar data of the second user;
generating a combined avatar that displays the avatar data of the first user with avatar data of the second user; and
displaying, on the device of the second user, the combined avatar overlaid on the image feature in the live feed, the combined avatar being anchored to the image feature.

17. The device of claim 16 , wherein the combined avatar is generated from a combined avatar template that arranges the avatar data of the first user and the avatar data of the second user into a predefined configuration.

18. The device of claim 16 , wherein the operations further comprise:
generating an electronic message for transmission to the first user account, the electronic message comprising the combined avatar; and
transmitting, to the second user account, the electronic message comprising the combined avatar.

19. The device of claim 18 , wherein the electronic message is an ephemeral message that automatically expires after a specified time duration such that the ephemeral message is no longer accessible through the social network application after expiration.

20. A non-transitory machine-readable storage device embodying instructions that, when executed by a device, cause the device to perform operations comprising:
identifying an image feature in a live feed from an image sensor of the devic

Assignees

• Snap Inc

Inventors

• Charlton Ebony James
• Cansizoglu Omer
• Ouimet Kirk
• Boyd Nathan Kenneth

Classifications

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• A63F13/00

  Video games, i.e. games using an electronically generated display having two or more dimensions · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title

• A63F13/352

  involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world · CPC title

• A63F13/58

  by computing conditions of game characters, e.g. stamina, strength, motivation or energy level · CPC title