Electronic device for providing avatar animation and method thereof

Patent metadata

Field	Value
Publication number	US-2020258280-A1
Application number	US-202016778118-A
Country	US
Kind code	A1
Filing date	Jan 31, 2020
Priority date	Feb 7, 2019
Publication date	Aug 13, 2020
Grant date	—

Abstract

An electronic device includes a display, at least one sensor, a processor operatively connected to the display and the at least one sensor, and a memory operatively connected to the processor. The memory stores instructions that, when executed, cause the processor to control the electronic device to obtain a first input associated with generation of a first avatar animation, to obtain first data for a first object based on the obtained first input, to obtain second data for a second object based on the obtained first input and a specified scheme, to generate the first avatar animation based on the first data and the second data, and to display the first avatar animation.

First claim

What is claimed is:

1 . An electronic device comprising:
a display; at least one sensor; a processor operatively connected to the display and the at least one sensor; and a memory operatively connected to the processor, wherein the memory is configured to store instructions that, when executed, cause the processor to control the electronic device to: obtain a first input associated with generation of a first avatar animation through the at least one sensor, wherein the first avatar animation includes a first object and a second object indicating a location different from the first object; obtain first data for the first object based on the obtained first input; obtain second data for the second object based on the obtained first input and a specified scheme; generate the first avatar animation based on the first data and the second data; and display the first avatar animation through the display.

2 . The electronic device of claim 1 , wherein the at least one sensor includes at least one of a touch sensor, a motion sensor, or an image sensor,
wherein the instructions, when executed, cause the processor to control the electronic device to: receive at least one of an image input or a user input through the at least one sensor; and obtain motion data for at least one of the first object or the second object from at least one of the image input or the user input.

3 . The electronic device of claim 1 , wherein the specified scheme includes at least one of a rule-based animation generation scheme, a physically-based animation generation scheme, a machine learning-based animation generation scheme, or a constraint-based animation generation scheme.

4 . The electronic device of claim 1 , wherein the instructions, when executed, cause the processor to control the electronic device to:
identify whether the first object and the second object satisfy a specified condition; obtain the first data based on the obtained first input based on the first object not satisfying the specified condition; and obtain the second data based on the obtained first input and the specified scheme based on the second object satisfying the specified condition.

5 . The electronic device of claim 4 , wherein the instructions, when executed, cause the processor to control the electronic device to:
identify that the second object satisfies the specified condition based on a resolution of an image corresponding to the second object being less than a threshold value, based on the second object being out of a specified range, or based on the second object corresponding to a specified portion in the first avatar animation.

6 . The electronic device of claim 1 , wherein the instructions, when executed, cause the processor to control the electronic device to:
perform interpolation on the first data or the second data based on a number of frames of the first data not being equal to a number of frames of the second data; and generate the first avatar animation by composing the first data and the second data.

7 . The electronic device of claim 6 , wherein the instructions, when executed, cause the processor to control the electronic device to:
generate the first avatar animation by performing motion stitching on the first data and the second data.

8 . The electronic device of claim 1 , further comprising:
a cache memory, wherein the instructions, when executed, cause the processor to control the electronic device to: store the second data in the cache memory; obtain a second input associated with generation of a second avatar animation through the at least one sensor, wherein the second avatar animation includes the first object and the second object; obtain third data for the first object based on the obtained second input; obtain the second data for the second object based on the second data stored in the cache memory; generate the second avatar animation based on the third data and the second data; and display the second avatar animation through the display.

9 . A method of controlling an electronic device, the method comprising:
obtaining a first input associated with generation of a first avatar animation, wherein the first avatar animation includes a first object and a second object indicating a location different from the first object; obtaining first data for the first object based on the obtained first input; obtaining second data for the second object based on the obtained first input and a specified scheme; generating the first avatar animation based on the first data and the second data; and displaying the first avatar animation through a display.

10 . The method of claim 9 , wherein the obtaining of the first input includes:
receiving at least one of an image input or a user input; and obtaining motion data from at least one of the image input or the user input.

11 . The method of claim 10 , wherein the specified scheme includes at least one of a rule-based animation generation scheme, a physically-based animation generation scheme, a machine learning-based animation generation scheme, or a constraint-based animation generation scheme.

12 . The method of claim 9 , wherein the obtaining of the first data includes:
identifying whether the first object satisfies a specified condition; and obtaining the first data based on the obtained first input based on the first object not satisfying the specified condition, and wherein the obtaining of the second data includes: identifying whether the second object satisfies the specified condition; and obtaining the second data based on the obtained first input and the specified scheme based on the second object satisfying the specified condition.

13 . The method of claim 12 , wherein the identifying of whether the second object satisfies the specified condition includes:
identifying whether a resolution of an image corresponding to the second object is less than a threshold value, whether the second object is out of a specified range, or whether the second object corresponds to a specified portion in the first avatar animation.

14 . The method of claim 9 , wherein the generating of the first avatar animation includes:
performing interpolation on the first data or the second data based on a number of frames of the first data not being equal to a number of frames of the second data; and generating the first avatar animation by composing the first data and the second data.

15 . The method of claim 14 , wherein the composing of the first data and the second data includes:
performing motion stitching on the first data and the second data.

16 . An electronic device comprising:
a display; at least one sensor; a processor operatively connected to the display and the at least one sensor; and a memory operatively connected to the processor, wherein the memory is configured to store instructions that, when executed, cause the processor to control the electronic device to: obtain a first input associated with generation of a first avatar animation through the at least one sensor; identify whether a first object included in the first avatar animation satisfies a specified condition; generate first data for the first object based on the first input based on the first object not satisfying the specified condition or obtain second data for the object based on the first input and a specified scheme based on the first object satisfying the specified condition; generate the first avatar animation based on the first data or the second data; and display the first avatar animation through the display.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Jongpil
• Kim Yunhyeong
• Yang Jaeeun
• Choi Kihwan
• Park Chanmin
• Lee Jungeun

Classifications

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T2213/12

  Rule based animation · CPC title