System and method of generating a live streaming video having real-time special effects

Patent metadata

Field	Value
Publication number	US-2025262551-A1
Application number	US-202519202316-A
Country	US
Kind code	A1
Filing date	May 8, 2025
Priority date	Oct 26, 2018
Publication date	Aug 21, 2025
Grant date	—

Abstract

Method for generating a live streaming video having real-time special effects starts with a processor displaying on a display device a lens selection user interface including a plurality of lens selections. The lens selections are associated with a plurality of special effects, respectively, and include a first lens selection associated with a first special effect and a second lens selection associated with a second special effect. The processor then receiving a selection of the first lens selection and applies in real-time the first special effect to a video stream captured by a camera to generate a video stream having the first special effect. The processor then transmits in real-time the video stream having the first special effect via a network to be displayed on a plurality of client devices. Other embodiments are disclosed.

First claim

What is claimed is:

1 . A method comprising:
receiving, over a network from a server, a plurality of digital filters, wherein each digital filter is configured to apply a real-time special effect to a live video stream, and wherein the received plurality of digital filters is one collection from multiple collections of digital filters managed by a filter management system on the server; displaying a special effect selection interface including a plurality of user-selectable icons, each user-selectable icon representing a digital filter in the collection received from the server, each digital filter for augmenting the live video stream by applying a real-time special effect; detecting a selection of a first user-selectable icon associated with a first digital filter; and transmitting in real-time, via the network, the live video stream having the first real-time special effect applied by the first digital filter to be displayed during a video communication session.

2 . The method of claim 1 , wherein the filter management system comprises a curation interface that automatically curates the collections of digital filters using machine vision and content rules to detect and remove inappropriate content.

3 . The method of claim 1 , further comprising:
receiving user preferences from the server based on social network information associated with a user; and filtering the displayed user-selectable icons based on the received user preferences.

4 . The method of claim 1 , wherein transmitting the live video stream comprises:
detecting a face in the live video stream; taking facial features into consideration when applying the first real-time special effect; and modifying an appearance of the live video stream based on specific facial features and facial shape.

5 . The method of claim 1 , further comprising:
receiving an input comprising a set of keyboard keys; associating the set of keyboard keys with the first digital filter; and
wherein detecting the selection comprises detecting activation of the set of keyboard keys.

6 . The method of claim 1 , wherein the special effect selection interface comprises a search function for searching specific digital filters within the collection using text input.

7 . The method of claim 1 , further comprising:
displaying an icon associated with the first digital filter during transmission of the live video stream; and enabling download of the first digital filter through activation of an embedded code associated with the displayed icon.

8 . A system comprising:
at least one processor; and at least one memory storage device storing instructions thereon, which, when executed by the at least one processor, cause the system to perform operations comprising: receiving, over a network from a server, a plurality of digital filters, wherein each digital filter is configured to apply a real-time special effect to a live video stream, and wherein the received plurality of digital filters is one collection from multiple collections of digital filters managed by a filter management system on the server; displaying a special effect selection interface including a plurality of user-selectable icons, each user-selectable icon representing a digital filter in the collection received from the server, each digital filter for augmenting the live video stream by applying a real-time special effect; detecting a selection of a first user-selectable icon associated with a first digital filter; and transmitting in real-time, via the network, the live video stream having the first real-time special effect applied by the first digital filter to be displayed during a video communication session.

9 . The system of claim 8 , wherein the filter management system comprises a curation interface that automatically curates the collections of digital filters using machine vision and content rules to detect and remove inappropriate content.

10 . The system of claim 8 , further comprising:
receiving user preferences from the server based on social network information associated with a user; and filtering the displayed user-selectable icons based on the received user preferences.

11 . The system of claim 8 , wherein transmitting the live video stream comprises:
detecting a face in the live video stream; taking facial features into consideration when applying the first real-time special effect; and modifying an appearance of the live video stream based on specific facial features and facial shape.

12 . The system of claim 8 , further comprising:
receiving an input comprising a set of keyboard keys; associating the set of keyboard keys with the first digital filter; and
wherein detecting the selection comprises detecting activation of the set of keyboard keys.

13 . The system of claim 8 , wherein the special effect selection interface comprises a search function for searching specific digital filters within the collection using text input.

14 . The system of claim 8 , further comprising:
displaying an icon associated with the first digital filter during transmission of the live video stream; and enabling download of the first digital filter through activation of an embedded code associated with the displayed icon.

15 . A machine-readable medium storing instructions thereon, which, when executed by at least one processor, cause the at least one processor to perform operations comprising:
receiving, over a network from a server, a plurality of digital filters, wherein each digital filter is configured to apply a real-time special effect to a live video stream, and wherein the received plurality of digital filters is one collection from multiple collections of digital filters managed by a filter management system on the server; displaying a special effect selection interface including a plurality of user-selectable icons, each user-selectable icon representing a digital filter in the collection received from the server, each digital filter for augmenting the live video stream by applying a real-time special effect; detecting a selection of a first user-selectable icon associated with a first digital filter; and transmitting in real-time, via the network, the live video stream having the first real-time special effect applied by the first digital filter to be displayed during a video communication session.

16 . The machine-readable medium of claim 15 , wherein the filter management system comprises a curation interface that automatically curates the collections of digital filters using machine vision and content rules to detect and remove inappropriate content.

17 . The machine-readable medium of claim 15 , further comprising:
receiving user preferences from the server based on social network information associated with a user; and filtering the displayed user-selectable icons based on the received user preferences.

18 . The machine-readable medium of claim 15 , wherein transmitting the live video stream comprises:
detecting a face in the live video stream; taking facial features into consideration when applying the first real-time special effect; and modifying an appearance of the live video stream based on specific facial features and facial shape.

19 . The machine-readable medium of claim 15 , further comprising:
receiving an input comprising a set of keyboard keys; associating the set of keyboard keys with the first digital filter; and
wherein detecting the selection comprises detecting activation of the set of keyboard keys.

Assignees

• Snap Inc

Inventors

• Gaiduchenko Artem
• Yerofieiev Artem
• Pozharskyi Bohdan
• Lupin Gabriel
• Kholovchuk Oleksii
• Chen Travis
• Monastyrshyn Yurii
• Makoviichuk Denys

Classifications

• H04N21/42204

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• H04N21/44

  Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs · CPC title

• H04N21/234

  Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs · CPC title

• H04N21/4781

  Games · CPC title

• H04N21/4312

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title