Electronic device for providing shooting mode based on virtual character and operation method thereof

Patent metadata

Field	Value
Publication number	US-2025086970-A1
Application number	US-202418958590-A
Country	US
Kind code	A1
Filing date	Nov 25, 2024
Priority date	Feb 19, 2019
Publication date	Mar 13, 2025
Grant date	—

Abstract

An electronic device according to an embodiment may include: a camera module; a display; and a processor, wherein the processor may be configured to: obtain a preview image corresponding to an external object using the camera module; determine attributes of the external object, based on the obtained preview image; synthesize the preview image with a virtual character image, based on the attributes of the external object; and output the synthesized preview image through the display. Other embodiments may be provided.

First claim

What is claimed is:

1 . An electronic device comprising:
a camera; a display; at least one processor; and memory storing instructions that, when executed by the processor, cause the electronic device to:
execute an application,
obtain a preview image through the camera,
display the preview image obtained through the camera on the display,
receive an input for generating an avatar,
in response to the input for generating the avatar, identify a face image in the preview image,
generate an avatar image which has features related to the face image, and
display, through the display, the avatar image with the preview image such that the avatar image is located on the face image in the preview image.

2 . The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to display an interface for changing at least one aspect of the avatar image.

3 . The electronic device of claim 1 , wherein generating the avatar image includes selecting avatar features reflecting the features of the face image for inclusion in the avatar image, such that the generated avatar image resembles the face image.

4 . The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to:
based on an input for selecting the avatar image located on the face image in the image, display an interface for editing the avatar, the interface including a plurality of UI items for changing an attribute of the avatar, and based on an input for selecting a UI item included in the interface, modify a visual appearance of the avatar by incorporating an attribute of a selected UI item into the avatar.

5 . The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to change the type of the avatar that simulates the motion of the object, based on an input selecting a UI item included in the interface.

6 . The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to change at least one of the shape or size of eyes, the nose, the mouth, hair color, hair style, face type, a skin color, and costume of the avatar, based on an input selecting a UI item included in the interface.

7 . The electronic device of claim 2 , wherein the instructions, when executed by the processor, cause the electronic device to determine a gender, an age and/or a race of a virtual character based on user inputs.

8 . The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
identify the face image in the preview image, generate a synthesized preview image by synthesizing the avatar image with the preview image such that the avatar image is located on the face image in the preview image.

9 . The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
detect the face image within the preview image, determine whether the face image is a predetermined size, based on a size of the face image, and determine a mask mode for replacing the face image in the preview image using the avatar image, when the face image is greater than or equal to the predetermined size.

10 . The electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the electronic device to:
extract features of a user's face from the face image in the preview image, and generate the avatar image having features similar to the face image based on the extracted features of the user's face.

11 . The electronic device of claim 10 , wherein the extracted features correspond to a face contour, a pupil, a shape or size of eyes, a nose, a mouth, and/or a skin color included in the face image.

12 . The electronic device of claim 11 , wherein the instructions, when executed by the processor, cause the electronic device to:
determine a tracking level with respect to the face image, and extract the features of the user's face from the face image based on the determined tracking level.

13 . The electronic device of claim 12 , wherein the tracking level is determined based on a size of an imaging area corresponding to the face image in the preview image.

14 . A method of generating an avatar image in an electronic device, the method comprising:
executing an application; obtaining a preview image through a camera while the application is executed; displaying the preview image obtained through the camera on a display; receiving an input for generating an avatar; in response to the input for generating the avatar, identifying a face image in the preview image; generating an avatar image which has features related to the face image; and
displaying, through the display, the avatar image with the preview image such that the avatar image is located on the face image in the preview image.

15 . The method of claim 14 , further comprising:
displaying an interface for changing at least one aspect of the avatar image, and wherein generating the avatar image includes selecting avatar features reflecting the features of the face image for inclusion in the avatar image, such that the generated avatar image resembles the face image.

16 . The method of claim 14 , further comprising:
based on an input for selecting the avatar image located on the face image in the image, displaying an interface for editing the avatar, the interface including a plurality of UI items for changing an attribute of the avatar, and based on an input for selecting a UI item included in the interface, modifying a visual appearance of the avatar by incorporating an attribute of a selected UI item into the avatar.

17 . The method of claim 14 , further comprising:
extracting features of a user's face from the face image in the preview image, and generating the avatar image having features similar to the face image based on the extracted features of the user's face, wherein the extracted features correspond to a face contour, a pupil, a shape or size of eyes, a nose, a mouth, and/or a skin color included in the face image.

18 . The method of claim 15 , further comprising:
changing the type of the avatar that simulates the motion of the object, based on an input selecting a UI item included in the interface.

19 . The method of claim 14 , wherein generating of the avatar image comprises:
identifying the face image in the preview image, and generating a synthesized preview image by synthesizing the avatar image with the preview image such that the avatar image is located on the face image in the preview image.

20 . A non-transitory computer-readable recording medium storing a program which, when executed, causes an electronic device to perform operations comprising:
executing an application; obtaining a preview image through a camera while the application is executed; displaying the preview image obtained through the camera on a display; receiving an input for generating an avatar; in response to the input for generating the avatar, identifying a face image in the preview image; generating an avatar image which has features related to the face image; and displaying, through the display, the avatar image with the preview image such that the avatar image is located on the face image in the preview image.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Wooyong
• Baik Seunghyup
• Park Chanmin
• Kang Hyejin
• Lee Jungeun

Classifications

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/95

  Computational photography systems, e.g. light-field imaging systems · CPC title

• G06V40/168

  Feature extraction; Face representation · CPC title

• G06V20/64

  Three-dimensional [3D] objects · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title