Augmented reality beauty product tutorials

Patent metadata

Field	Value
Publication number	US-12488551-B2
Application number	US-202418740713-A
Country	US
Kind code	B2
Filing date	Jun 12, 2024
Priority date	Mar 31, 2020
Publication date	Dec 2, 2025
Grant date	Dec 2, 2025

Abstract

Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

First claim

What is claimed is:

1 . A system comprising:
at least one processor; at least one computer screen coupled to the at least one processor; at least one memory including instructions that, when executed by the at least one processor, cause the system to perform operations comprising: accessing a beauty product tutorial comprising effects from applying a beauty product and indications of motion of the beauty product, the indications of motion of the beauty product indicating the motion used in applying the beauty product; processing live images of a user to add the effects and the indications of motion of the beauty product; and displaying the beauty product tutorial and the processed live images so that the effects are displayed simultaneously on a first portion of a computer screen with corresponding effects of the beauty product tutorial on a second portion of the computer screen.

2 . The system of claim 1 , wherein the beauty product tutorial further comprises pre-recorded images of a presenter applying the beauty product to a body part of the presenter.

3 . The system of claim 2 , wherein the operations further comprise:
determining the body part based on stored images of body parts.

4 . The system of claim 2 , wherein the operations further comprise:
determining the effects based on changes to the pre-recorded images of the presenter from the beauty product being applied to the body part of the presenter; and determining, based on the effects, the indications of motion of the beauty product indicating the motion used by the presenter in applying the beauty product.

5 . The system of claim 4 , wherein the indications of motion are further determined based on a predetermined color of the beauty product.

6 . The system of claim 4 , wherein the effects are further determined based on a predetermined color of the beauty product.

7 . The system of claim 4 , wherein the effects are determined based on comparing successive images of the presenter.

8 . The system of claim 4 , wherein the effects and the determined indications of motion are stored to indicate changes from a first image of the live images to a second image of the live images.

9 . The system of claim 1 , wherein the operations further comprise:
determining from the beauty product tutorial a body part of a presenter; and adjusting the processed live images of the user to zoom in on the body part of the user.

10 . The system of claim 1 , wherein the effects are determined using a neural network.

11 . The system of claim 1 , wherein the processing the live images of the user to add the effects further comprises:
modifying the effects in accordance with a position of a body part of the user.

12 . The system of claim 1 , wherein the beauty product tutorial comprises a number of steps, and wherein the operations further comprise:
proceeding to a next step based on input received from the user.

13 . A method comprising:
accessing a beauty product tutorial comprising effects from applying a beauty product and indications of motion of the beauty product, the indications of motion of the beauty product indicating the motion used in applying the beauty product; processing live images of a user to add the effects and the indications of motion of the beauty product; and displaying the beauty product tutorial and the processed live images so that the effects are displayed simultaneously on a first portion of a computer screen with corresponding effects of the beauty product tutorial on a second portion of the computer screen.

14 . The method of claim 13 , wherein the beauty product tutorial further comprises pre-recorded images of a presenter applying the beauty product to a body part of the presenter.

15 . A non-transitory computer-readable medium comprising instructions, which when executed by one or more processors, cause the one or more processors to perform operations comprising:
accessing a beauty product tutorial comprising effects from applying a beauty product and indications of motion of the beauty product, the indications of motion of the beauty product indicating the motion used in applying the beauty product; processing live images of a user to add the effects and the indications of motion of the beauty product; and displaying the beauty product tutorial and the processed live images so that the effects are displayed simultaneously on a first portion of a computer screen with corresponding effects of the beauty product tutorial on a second portion of the computer screen.

16 . The non-transitory computer-readable medium of claim 15 , wherein the beauty product tutorial further comprises pre-recorded images of a presenter applying the beauty product to a body part of the presenter.

17 . The non-transitory computer-readable medium of claim 16 , wherein the operations further comprise:
determining the body part based on stored images of body parts.

18 . The non-transitory computer-readable medium of claim 15 , wherein the beauty product tutorial further comprises pre-recorded images of a presenter applying the beauty product to a body part of the presenter.

19 . The non-transitory computer-readable medium of claim of claim 18 , wherein the operations further comprise:
determining the effects based on changes to the pre-recorded images of the presenter from the beauty product being applied to the body part of the presenter; and determining, based on the effects, the indications of motion of the beauty product indicating the motion used by the presenter in applying the beauty product.

20 . The non-transitory computer-readable medium of claim of claim 19 , wherein the indications of motion are further determined based on a predetermined color of the beauty product.

Assignees

• Snap Inc

Inventors

• Barron Christine
• Drummond Virginia
• Luo Jean
• Matthiessen Alek
• Mourkogiannis Celia Nicole
• Solichin Jonathan
• Voronova Olesia

Classifications

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T2207/30201

  Face · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title