Electronic device for generating image including 3D avatar reflecting face motion through 3D avatar corresponding to face and method of operating same

Patent metadata

Field	Value
Publication number	US-12277665-B2
Application number	US-202318452883-A
Country	US
Kind code	B2
Filing date	Aug 21, 2023
Priority date	Feb 23, 2018
Publication date	Apr 15, 2025
Grant date	Apr 15, 2025

Abstract

An electronic device is provided. The electronic device includes a camera, a display, and a processor configured to obtain a first image including one or more external objects by using the camera, display to output a three-dimensional (3D) object generated based on attributes related to a face among the one or more external objects using the display, receive a selection of at least one graphic attribute from a plurality of graphic attributes which can be applied to the 3D object, generate a 3D avatar for the face based on the at least one graphic attribute, and generate a second image including at least one object reflecting a predetermined facial expression or motion using the 3D avatar.

First claim

What is claimed is:

1. An electronic device, comprising:
at least one camera;
a touchscreen display;
at least one processor; and
memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to:
obtain, via the at least one camera, at least one image with respect to a user,
based on the obtaining of the at least one image, display a first three-dimensional (3D) graphic object by applying attribute pre-designated to a 3D template stored in the memory,
based on the first 3D graphic object, generate and display a 3D avatar including a first animation effect on the touchscreen display, wherein the first animation effect is based on a movement of each part of a face of the user, wherein the movement of each part of the face of the user is identified based on the at least one image with respect to the face of the user being obtained in real time, and wherein the first animation effect is applicable to another 3D graphic object generated by applying the attribute pre-designated to the 3D template,
detect a change of the each part of the face of the user based on the at least one image, change the 3D avatar, including a second animation effect different from the first animation effect, based on the change of the each part of the face of the user in real time,
based on reception of a first input to transmit the changed 3D avatar including the second animation effect, display a preview with respect to the changed 3D avatar on an execution screen of a message application, and
based on reception of a second input to an send icon included in the execution screen of the message application, transmit the changed 3D avatar including the second animation effect to counterpart device.

2. The electronic device of claim 1 , wherein a format of the 3D avatar is graphic interchange format (GIF).

3. The electronic device of claim 1 ,
wherein the 3D avatar is capable of being transmitted using a plurality of applications, and wherein the plurality of applications include a message application, a social networking service (SNS) application, and an e-mail application.

4. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:
identify a facial expression of the user based on at least one image obtained via at least one camera.

5. The electronic device of claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:
based on at least one graphic attribute from among a plurality of graphic attributes, generate a plurality of 3D templates for generating the 3D avatar.

6. A non-transitory storage medium storing one or more programs, the one or more programs comprising computer-executable instructions configured to, when executed by at least one processor of an electronic device, cause the electronic device to:
obtain, via at least one camera of the electronic device, at least one image with respect to a user;
based on the obtaining of the at least one image, display a first three-dimensional (3D) graphic object by applying attribute pre-designated to a 3D template stored in memory of the electronic device;
based on the first 3D graphic object, generate and display a 3D avatar including a first animation effect on a touchscreen display of the electronic device, wherein the first animation effect is based on a movement of each part of a face of the user, wherein the movement of each part of the face of the user is identified based on the at least one image with respect to the face of the user being obtained in real time, and wherein the first animation effect is applicable to another 3D graphic object generated by applying the attribute pre-designated to the 3D template;
detect a change of the each part of the face of the user based on the at least one image, change the 3D avatar, including a second animation effect different from the first animation effect, based on the change of the each part of the face of the user in real time;
based on reception of a first input to transmit the changed 3D avatar including the second animation effect, display a preview with respect to the changed 3D avatar on an execution screen of a message application; and
based on reception of a second input to a send icon included in the execution screen of the message application, transmit the changed 3D avatar including the second animation effect to counterpart device.

7. The non-transitory storage medium of claim 6 , wherein a format of the 3D avatar is graphic interchange format (GIF).

8. The non-transitory storage medium of claim 6 ,
wherein the 3D avatar is capable of being transmitted using a plurality of applications, and
wherein the plurality of applications include a message application, a social networking service (SNS) application, and an e-mail application.

9. The non-transitory storage medium of claim 6 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:
identify a facial expression of the user based on at least one image obtained via at least one camera.

10. The non-transitory storage medium of claim 6 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:
based on at least one graphic attribute from among a plurality of graphic attributes, generate a plurality of 3 D templates for generating the 3D avatar.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Wooyong
• Kim Yonggyoo
• Min Byunghyun
• Son Dongil
• Yoon Chanhee
• Lee Kihuk
• Cheong Cheolho

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T2207/30201

  Face · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V40/168

  Feature extraction; Face representation · CPC title