Annotating an image with a texture fill

Patent metadata

Field	Value
Publication number	US-10891768-B2
Application number	US-202015929284-A
Country	US
Kind code	B2
Filing date	Apr 22, 2020
Priority date	Jun 9, 2017
Publication date	Jan 12, 2021
Grant date	Jan 12, 2021

Abstract

Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.

First claim

What is claimed is:

1. A method comprising:
accessing user input data defining a border with respect to a target digital image, the border separating a first portion of the target digital image from a second portion of the target digital image, the first portion being disposed within the border, and the second portion being disposed outside of the border;
applying a contouring technique to coordinate data received via the user input data, the applying of the contouring technique to the coordinate data yielding the border;
selecting, based on a sample digital mage for a media overlay, a texturing technique from a set of texturing techniques;
generating the media overlay using the selected texturing technique;
generating a contour mask for the target digital image based on the border with respect to the target digital image; and
applying the media overlay to the target digital image based on the contour mask to yield an annotated digital image.

2. The method of claim 1 , wherein the sample digital image is smaller than the target digital image.

3. The method of claim 1 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
applying a texture transfer technique to the media overlay and the target digital image based on the contour mask to yield the annotated digital image.

4. The method of claim 1 , wherein the sample digital image is selected by a user.

5. The method of claim 1 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
accessing the media overlay, the media overlay being a full digital image; and
applying, based on the contour mask, the media overlay to the target digital image using a Laplacian blending to yield the annotated digital image.

6. The method of claim 1 , wherein the sample digital image is smaller than the target digital image, and wherein the generating the media overlay using the selected texturing technique comprises duplicating the sample digital image based on a size of the target digital image to yield the media overlay.

7. An annotation system comprising:
one or more computer processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the annotation system to perform operations comprising:
accessing user input data defining a border with respect to a target digital image, the border separating a first portion of the target digital image from a second portion of the target digital image, the first portion being disposed within the border, and the second portion being disposed outside of the border;
applying a contouring technique to coordinate data received via the user input data, the applying of the contouring technique to the coordinate data yielding the border;
selecting, based on a sample digital image for a media overlay, a texturing technique from a set of texturing techniques;
generating the media overlay using the selected texturing technique;
generating a contour mask for the target digital image based on the border with respect to the target digital image; and
applying the media overlay to the target digital image based on the contour mask to yield an annotated digital image.

8. The annotation system of claim 7 , wherein the sample digital image is smaller than the target digital image.

9. The annotation system of claim 7 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
applying a texture transfer technique to the media overlay and the target digital image based on the contour mask to yield the annotated digital image.

10. The annotation system of claim 7 , wherein the sample digital image is selected by a user.

11. The annotation system of claim 7 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
accessing the media overlay, the media overlay being a full digital image; and
applying, based on the contour mask, the media overlay to the target digital image using a Laplacian blending to yield the annotated digital image.

12. The annotation system of claim 7 , wherein the sample digital image is smaller than the target digital image, and wherein the generating the media overlay using the selected texturing technique comprises duplicating the sample digital image based on a size of the target digital image to yield the media overlay.

13. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations comprising:
accessing user input data defining a border with respect to a target digital image, the border separating a first portion of the target digital image from a second portion of the target digital image, the first portion being disposed within the border, and the second portion being disposed outside of the border;
applying a contouring technique to coordinate data received via the user input data, the applying of the contouring technique to the coordinate data yielding the border;
selecting, based on a sample digital image for a media overlay, a texturing technique from a set of texturing techniques;
generating the media overlay using the selected texturing technique;
generating a contour mask for the target digital image based on the border with respect to the target digital image; and
applying the media overlay to the target digital image based on the contour mask to yield an annotated digital image.

14. The non-transitory computer-readable medium of claim 13 , wherein the sample digital image is smaller than the target digital image.

15. The non-transitory computer-readable medium of claim 13 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
applying a texture transfer technique to the media overlay and the target digital image based on the contour mask to yield the annotated digital image.

16. The non-transitory computer-readable medium of claim 13 , wherein the sample digital image is selected by a user.

17. The non-transitory computer-readable medium of claim 13 , wherein the applying the media overlay to the target digital image based on the contour mask to yield the annotated digital image comprises:
accessing the media overlay, the media overlay being a full digital image; and
applying, based on the contour mask, the media overlay to the target digital image using a Laplacian blending to yield the annotated digital image.

18. The non-transitory computer-readable medium of claim 13 , wherein the sample digital image is smaller than the target digital image, and wherein the generating the media overlay using the selected texturing technique comprises duplicating the sample digital image based on a size of the target digital image to yield the media overlay.

Assignees

• Snap Inc

Inventors

• Hu Nan
• Mei Xing
• Ma Chongyang
• Duan Kun

Classifications

• G06Q10/40 Primary

  Business processes related to social networking or social networking services · CPC title

• H04L51/52

  for supporting social networking services · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• H04L51/10

  Multimedia information · CPC title

• G06T7/149

  involving deformable models, e.g. active contour models · CPC title