Electronic device for generating image including 3d avatar reflecting face motion through 3d avatar corresponding to face and method of operating same

Patent metadata

Field	Value
Publication number	US-2021192858-A1
Application number	US-202117194837-A
Country	US
Kind code	A1
Filing date	Mar 8, 2021
Priority date	Feb 23, 2018
Publication date	Jun 24, 2021
Grant date	—

Abstract

An electronic device is provided. The electronic device includes a camera, a display, and a processor configured to obtain a first image including one or more external objects by using the camera, display to output a three-dimensional (3D) object generated based on attributes related to a face among the one or more external objects using the display, receive a selection of at least one graphic attribute from a plurality of graphic attributes which can be applied to the 3D object, generate a 3D avatar for the face based on the at least one graphic attribute, and generate a second image including at least one object reflecting a predetermined facial expression or motion using the 3D avatar.

First claim

What is claimed is:

1 . An electronic device comprising:
a camera; a display; and a processor configured to:
capture at least one image including a face of a user by using the camera,
control the display to display a three-dimensional (3D) object comprising an animation effect relate to a facial expression of the user identified based on the at least one image,
obtain a first image including the 3D object comprising the animation effect, and
transmit the first image to an external electronic device, wherein the first image is capable of being transmitted using a plurality of applications.

2 . The electronic device of claim 1 , wherein a format of the obtained first image is graphic interchange format (GIF).

3 . The electronic device of claim 1 , wherein the plurality of applications include a message application, a social networking service (SNS) application, and an e-mail application.

4 . The electronic device of claim 1 , wherein the at least one processor is configured to:
identify the facial expression of the user based on the at least one image, and obtain the 3D object comprising the animation effect, based on applying the animation effect relate to the facial expression of the user to a 3D template.

5 . The electronic device of claim 4 , wherein the 3D template is a first 3D template comprising animal shape, or a second 3D template comprising a character shape.

6 . The electronic device of claim 5 , wherein the at least one processor is configured to:
control the display to display the first image on an execution screen of a message application, and based on a user input for transmitting the first image on the execution screen of the message application, transmit the first image to the external electronic device based on the message application.

7 . The electronic device of claim 5 , wherein the at least one processor is configured to:
based on at least one graphic attribute from among a plurality of graphic attributes, generate the 3D template.

8 . A method of an electronic device, comprising:
capturing at least one image including a face of a user by using a camera; controlling a display to display a three-dimensional (3D) object comprising an animation effect relate to a facial expression of the user identified based on the at least one image; obtaining a first image including the 3D object comprising the animation effect; and transmitting the first image to an external electronic device, wherein the first image is capable of being transmitted using a plurality of applications.

9 . The method of claim 8 , wherein a format of the obtained first image is graphic interchange format (GIF).

10 . The method of claim 8 , wherein the plurality of applications include a message application, a social networking service (SNS) application, and an e-mail application.

11 . The method of claim 8 , further comprising:
identifying the facial expression of the user based on the at least one image; and obtaining the 3D object comprising the animation effect, based on applying the animation effect relate to the facial expression of the user to a 3D template.

12 . The method of claim 11 , wherein the 3D template is a first 3D template comprising animal shape, or a second 3D template comprising a character shape.

13 . The method of claim 12 , further comprising:
controlling the display to display the first image on an execution screen of a message application; and based on a user input for transmitting the first image on the execution screen of the message application, transmitting the first image to the external electronic device based on the message application.

14 . The method of claim 12 , further comprising:
based on at least one graphic attribute from among a plurality of graphic attributes, generating the 3D template.

15 . A non-transitory computer-readable medium storing instructions, wherein, when the instructions are executed, the instructions cause at least one processor to:
capture at least one image including a face of a user by using a camera, control a display to display a three-dimensional (3D) object comprising an animation effect relate to a facial expression of the user identified based on the at least one image, obtain a first image including the 3D object comprising the animation effect, and transmit the first image to an external electronic device, wherein the first image is capable of being transmitted using a plurality of applications.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Wooyong
• Kim Yonggyoo
• Min Byunghyun
• Son Dongil
• Yoon Chanhee
• Lee Kihuk
• Cheong Cheolho

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V20/653

  by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces · CPC title

• G06V40/168

  Feature extraction; Face representation · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title