Method and device for processing image

Patent metadata

Field	Value
Publication number	US-2019304152-A1
Application number	US-201916364866-A
Country	US
Kind code	A1
Filing date	Mar 26, 2019
Priority date	Mar 29, 2018
Publication date	Oct 3, 2019
Grant date	—

Abstract

An image processing method is provided. The image processing method includes detecting a face of an object present on an image, obtaining at least one feature from the detected face as at least one facial parameter and obtaining at least one context related to the image as at least one contextual parameter, determining a manipulation point for manipulating the detected face, based on the obtained at least one facial parameter and the obtained at least one contextual parameter, and manipulating the image based on the determined manipulation point.

First claim

What is claimed is:

1 . An image processing method comprising:
detecting a face present in an image; obtaining at least one feature from the detected face as at least one facial parameter; obtaining at least one context related to the image as at least one contextual parameter; determining a manipulation point for manipulating the detected face, based on the obtained at least one facial parameter and the obtained at least one contextual parameter; and manipulating the image based on the determined manipulation point.

2 . The image processing method of claim 1 , wherein the determining of the manipulation point for manipulating the detected face comprises:
selecting at least one parameter to be used to determine the manipulation point from among the obtained at least one facial parameter, based on at least one of the obtained at least one contextual parameter.

3 . The image processing method of claim 1 , wherein the determining of the manipulation point for manipulating the detected face comprises:
selecting, from among the obtained at least one facial parameter, at least one parameter to be excluded from or corrected in a process of determining the manipulation point, based on at least one of the obtained at least one contextual parameter.

4 . The image processing method of claim 1 , wherein the determining of the manipulation point comprises:
when the obtained at least one contextual parameter is a plurality of contextual parameters:
generating a plurality of clusters by combining the obtained at least one contextual parameter according to various combination methods, and
selecting one of the generated plurality of clusters; and
determining the manipulation point corresponding to the selected cluster.

5 . The image processing method of claim 4 , wherein the selected cluster is selected using a machine learning algorithm with the obtained at least one contextual parameter as an input value.

6 . The image processing method of claim 1 , wherein the determining of the manipulation point comprises:
selecting, from a plurality of face models, a face model to be combined with the detected face.

7 . The image processing method of claim 6 , wherein the manipulating of the image comprises:
replacing at least a portion of the detected face with a corresponding portion of the selected face model.

8 . The image processing method of claim 1 ,
wherein the determining of the manipulation point comprises selecting one of a plurality of image filters based on the obtained at least one facial parameter and the obtained at least one contextual parameter, and wherein the manipulating of the image comprises applying the selected image filter to the image.

9 . The image processing method of claim 1 , wherein the at least one contextual parameter comprises at least one of person identification information for identifying at least one person appearing on the image, a profile of the identified at least one person, a profile of a user manipulating the image, a relationship between the user manipulating the image and the identified at least one person, a location where the image was captured, a time when the image was captured, weather of an image capture time, information about a device used to capture the image, an image manipulation history of the user manipulating the image and the identified at least one person, or evaluation information of the image.

10 . The image processing method of claim 6 , wherein the selecting of the one face model to be combined with the detected face comprises:
presenting a plurality of face models extracted based on the obtained at least one facial parameter and the obtained at least one contextual parameter to a user; and receiving a selection of one of the plurality of presented face models from the user.

11 . An image processing device comprising:
at least one processor configured to:
detect a face present in an image,
obtain at least one feature from the detected face as at least one facial parameter,
obtain at least one context related to the image as at least one contextual parameter,
determine a manipulation point for manipulating the detected face based on the obtained at least one facial parameter and the obtained at least one contextual parameter, and
manipulate the image based on the determined manipulation point; and
a display configured to display the manipulated image.

12 . The image processing device of claim 11 , wherein the at least one processor is further configured to select, from among the obtained at least one facial parameter, at least one parameter to be used to determine the manipulation point, based on at least one of the obtained at least one contextual parameter.

13 . The image processing device of claim 11 , wherein the at least one processor is further configured to select, from among the obtained at least one facial parameter, at least one parameter to be excluded from or corrected in a process of determining the manipulation point, based on at least one of the at least one contextual parameter.

14 . The image processing device of claim 11 , wherein the at least one processor is further configured to:
when the obtained at least one contextual parameter is a plurality of contextual parameters:
generate a plurality of clusters by combining the obtained at least one contextual parameter according to various combination methods, and
select one of the generated plurality of clusters, and
determine the manipulation point corresponding to the selected cluster.

15 . The image processing device of claim 14 , wherein the selected cluster is selected using a machine learning algorithm with the obtained at least one contextual parameter as an input value.

16 . The image processing device of claim 11 , wherein the at least one processor is further configured to determine the manipulation unit by selecting, from a plurality of face models, one face model to be combined with the detected face.

17 . The image processing device of claim 16 , wherein the at least one processor is further configured to manipulate the image by replacing at least a portion of the detected face with a corresponding portion of the selected face model.

18 . The image processing device of claim 11 , wherein the at least one processor is further configured to determine the manipulation unit by selecting one of a plurality of image filters based on the obtained at least one facial parameter and the obtained at least one contextual parameter, and manipulate the image by applying the selected image filter to the image.

19 . The image processing device of claim 11 , wherein the at least one contextual parameter comprises at least one of person identification information for identifying at least one person appearing on the image, a profile of the identified at least one person, a profile of a user manipulating the image, a relationship between the user manipulating the image and the identified at least one person, a location where the image was captured, a time when the image was captured, weather of an image capture time, information about a device used to capture the image, an image manipulation history of the user manipulating the image and the identified at least one person, or evaluation information of the image.

20 . A non-transitory computer-readable recording medium having recorded thereon a computer program for executing a method comprising:
detecting a face present in an image; obtaining at least one feature from the detected face as at

Assignees

• Samsung Electronics Co Ltd

Inventors

• Saà-Garriga Albert
• Saravanan Karthikeyan
• Vandini Alessandro
• Larreche Antoine
• Ansorregui Daniel

Classifications

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06T2207/30201

  Face · CPC title