Systems and methods for swapping faces and face components based on facial recognition

US2019206101A1 · US · A1

Patent metadata
FieldValue
Publication numberUS-2019206101-A1
Application numberUS-201715857200-A
CountryUS
Kind codeA1
Filing dateDec 28, 2017
Priority dateDec 28, 2017
Publication dateJul 4, 2019
Grant date

How to read this patent

A practical reading order for non-experts. Skip the full description unless you need deep technical detail.

  1. Title

    What the patent document calls the invention.

  2. Abstract

    A short plain-language summary of the technical disclosure.

  3. Assignees and inventors

    Who owns or filed the patent and who is credited as inventor.

  4. Key dates

    Filing, priority, publication, and grant dates set the timeline.

  5. First independent claim

    The legal scope of protection — read this for what is actually claimed.

  6. CPC / IPC classifications

    Technology tags used to group this patent with similar filings.

  7. Citations and related patents

    Prior art links and similar publications in this corpus.

Abstract

Official abstract text for this publication.

Systems, methods, and non-transitory computer readable media can obtain a first image depicting a face of a user. A plurality of images depicting the face of the user can be identified. A second image of the plurality of images can be identified based on one or more factors. The face or a portion of the face of the user in the first image can be replaced with the face or a portion of the face of the user in the second image.

First claim

Opening claim text (preview).

What is claimed is: 1 . A computer-implemented method comprising: obtaining, by a computing system, a first image depicting a face of a user; identifying, by the computing system, a plurality of images depicting the face of the user; identifying, by the computing system, a second image of the plurality of images based on one or more factors; and replacing, by the computing system, the face or a portion of the face of the user in the first image with the face or a portion of the face of the user in the second image. 2 . The computer-implemented method of claim 1 , wherein the one or more factors include one or more of: lighting conditions in an image, an orientation of the face of the user in an image, a resolution of an image, presence of accessories on the face of the user, or presence of makeup on the face of the user. 3 . The computer-implemented method of claim 1 , wherein the plurality of images depicting the face of the user is identified from a set of images on a computing device based on facial recognition. 4 . The computer-implemented method of claim 1 , wherein the replacing the face or a portion of the face of the user in the first image includes mapping facial points of the face or the portion of the face of the user in the second image to facial points of the face or the portion of the face of the user in the first image. 5 . The computer-implemented method of claim 1 , wherein the replacing the face or a portion of the face of the user in the first image includes blending a portion of the first image corresponding to the face or the portion of the face of the user and a portion of the second image corresponding to the face or the portion of the face of the user. 6 . The computer-implemented method of claim 1 , wherein the replacing the face or a portion of the face of the user in the first image is performed in real time, and wherein the first image is image data provided in a camera view. 7 . The computer-implemented method of claim 1 , wherein the replacing the face or a portion of the face of the user in the first image is performed after the first image is captured. 8 . The computer-implemented method of claim 1 , wherein the portion of the face is a face component, and the face component includes one or more of: eyes, a nose, a mouth, or ears. 9 . The computer-implemented method of claim 8 , wherein the one or more factors include a factor relating to the face component. 10 . The computer-implemented method of claim 1 , wherein the first image is associated with a video. 11 . A system comprising: at least one hardware processor; and a memory storing instructions that, when executed by the at least one processor, cause the system to perform: obtaining a first image depicting a face of a user; identifying a plurality of images depicting the face of the user; identifying a second image of the plurality of images based on one or more factors; and replacing the face or a portion of the face of the user in the first image with the face or a portion of the face of the user in the second image. 12 . The system of claim 11 , wherein the one or more factors include one or more of: lighting conditions in an image, an orientation of the face of the user in an image, a resolution of an image, presence of accessories on the face of the user, or presence of makeup on the face of the user. 13 . The system of claim 11 , wherein the replacing the face or a portion of the face of the user in the first image includes mapping facial points of the face or the portion of the face of the user in the second image to facial points of the face or the portion of the face of the user in the first image. 14 . The system of claim 11 , wherein the replacing the face or a portion of the face of the user in the first image includes blending a portion of the first image corresponding to the face or the portion of the face of the user and a portion of the second image corresponding to the face or the portion of the face of the user. 15 . The system of claim 11 , wherein the portion of the face is a face component, and the face component includes one or more of: eyes, a nose, a mouth, or ears. 16 . A non-transitory computer readable medium including instructions that, when executed by at least one hardware processor of a computing system, cause the computing system to perform a method comprising: obtaining a first image depicting a face of a user; identifying a plurality of images depicting the face of the user; identifying a second image of the plurality of images based on one or more factors; and replacing the face or a portion of the face of the user in the first image with the face or a portion of the face of the user in the second image. 17 . The non-transitory computer readable medium of claim 16 , wherein the one or more factors include one or more of: lighting conditions in an image, an orientation of the face of the user in an image, a resolution of an image, presence of accessories on the face of the user, or presence of makeup on the face of the user. 18 . The non-transitory computer readable medium of claim 16 , wherein the replacing the face or a portion of the face of the user in the first image includes mapping facial points of the face or the portion of the face of the user in the second image to facial points of the face or the portion of the face of the user in the first image. 19 . The non-transitory computer readable medium of claim 16 , wherein the replacing the face or a portion of the face of the user in the first image includes blending a portion of the first image corresponding to the face or the portion of the face of the user and a portion of the second image corresponding to the face or the portion of the face of the user. 20 . The non-transitory computer readable medium of claim 16 , wherein the portion of the face is a face component, and the face component includes one or more of: eyes, a nose, a mouth, or ears.

Assignees

Inventors

Classifications

  • G06T11/60Primary

    Creating or editing images; Combining images with text · CPC title

  • Physics · mapped topic

  • Physics · mapped topic

  • G06T11/00Primary

    Two-dimensional [2D] image generation · CPC title

  • Detection; Localisation; Normalisation · CPC title

Patent family

Related publications grouped by family.

External sources

Frequently asked questions

Answers are generated from the same data shown on this page.

What does patent US2019206101A1 cover?
Systems, methods, and non-transitory computer readable media can obtain a first image depicting a face of a user. A plurality of images depicting the face of the user can be identified. A second image of the plurality of images can be identified based on one or more factors. The face or a portion of the face of the user in the first image can be replaced with the face or a portion of the face o…
Who is the assignee on this patent?
Facebook Inc
What technology area does this patent fall under?
Primary CPC classification G06T11/60. Mapped technology areas include Physics.
When was this patent published?
Publication date Thu Jul 04 2019 00:00:00 GMT+0000 (Coordinated Universal Time) (A1). Legal status and post-grant events are not shown on this page.
What related patents are in patentsdb?
We list 3 related publications on this page (citations in our corpus or others sharing the same primary CPC).