Facial gesture driven animation communication system

Patent metadata

Field	Value
Publication number	US-9984487-B2
Application number	US-201414773911-A
Country	US
Kind code	B2
Filing date	Sep 24, 2014
Priority date	Sep 24, 2014
Publication date	May 29, 2018
Grant date	May 29, 2018

Abstract

Examples of systems and methods for transmitting facial motion data and animating an avatar are generally described herein. A system may include an image capture device to capture a series of images of a face, a facial recognition module to compute facial motion data for each of the images in the series of images, and a communication module to transmit the facial motion data to an animation device, wherein the animation device is to use the facial motion data to animate an avatar on the animation device.

First claim

What is claimed is:

1. A system for facial gesture driven animation communication, the system comprising:
an image capture device coupled to a mobile device, the image capture device to capture a series of images of a face of a user, wherein the image capture device is configured to capture an image corresponding to content of a second device, the second device to be viewed by the user, wherein the second device and mobile device comprise a second-screen usage system, when in operation by the user,
wherein the content of the second device is different than the series of images of the face of the user;
a facial recognition module to compute facial motion data for each of the images in the series of images;
a content module, when in operation, communicatively coupled to the mobile device, the content module to:
identify the content, using the image corresponding to the content, and
generate, using the identity of the content, a list of one or more content related avatars, the one or more content related avatars corresponding to the content of the second device;

a user interface configured to:
present the list of the one or more content related avatars to the user;
responsive to selection by the user, identify a selected content related avatar for animation using the facial motion data; and

a communication module to transmit the facial motion data to an animation device, wherein the animation device is to use the facial motion data to animate the selected content related avatar on the animation devices.

2. The system of claim 1 , wherein the animation device is to animate a user selected avatar.

3. The system of claim 1 , wherein the communication module transmits an avatar identification, corresponding to the content related avatar, to the animation device.

4. The system of claim 3 , wherein to animate the avatar, the animation device is to animate the content related avatar.

5. The system of claim 1 , wherein the image capture device captures a series of finger images and further comprising a finger recognition module to compute a set of finger gestures for each of the finger images.

6. The system of claim 5 , wherein the communication module transmits the set of finger gestures to the animation device, and wherein the animation device is further to use the set of finger gestures to animate the avatar on the animation device.

7. The system of claim 1 , further comprising a background module to generate a background image, wherein the background image is automatically selected based on contextual information, and wherein the animation device is to combine the background image with animation of the avatar when animating the avatar.

8. The system of claim 7 , wherein the communication module is to transmit the background image to the animation device.

9. The system of claim 7 , further comprising a location module to determine a location of the image capture device, and an avatar determination module to, using the location of the image capture device, generate a location-based avatar, wherein the contextual information is information corresponding to at least one of: the avatar, a background to the series of images of the face, or a location of the user.

10. The system of claim 9 , wherein to animate the avatar, the animation device is to animate the location-based avatar.

11. The system claim 1 , further comprising:
a physical input capture device to capture a series of physical inputs;
a physical input module to compute a set of physical input commands for the series of physical inputs; and
wherein the communication module transmits the set of physical input commands to the animation device, and wherein the animation device is to use the set of physical input commands to animate the avatar on the animation device.

12. At least one non-transitory machine-readable medium including instructions for changing an avatar, which when executed by a machine, cause the machine to:
capture a series of images of a face of a user;
compute facial motion data for each of the images in the series of images; and
transmit the facial motion data to an animation device, wherein the animation device is to use the facial motion data to animate an avatar on the animation device;
capture an image corresponding to content of a second device, the second device to be viewed by the user, wherein the second device and animation device comprise a second-screen usage system, when in operation by the user, wherein the content of the second device is different than the series of images of the user;
identify the content, using the image corresponding to the content;
generate, using the identity of the content, a list of one or more content related avatars, the one or more content related avatars corresponding to the content of the second device;
responsive to selection by the user; identify a selected content related avatar for animation using the facial motion data; and
transmit the selected content related avatar to the animation device wherein the animation device is to use the facial motion data to animate the selected content related avatar in place of the avatar, on the animation device.

13. The at least one machine-readable medium of claim 12 ,
wherein the animation device is to use the facial motion data to animate the content related avatar.

14. The at least one machine-readable medium of claim 12 , further comprising instructions, which when executed by a machine, cause the machine to:
compute a set of finger gestures for each of the finger images; and
wherein to transmit includes to transmit the set of finger gestures to the animation device; and
wherein the animation device is further to use the set of finger gestures to animate the avatar on the animation device.

15. The at least one machine-readable medium of claim 12 , further comprising instructions, which when executed by a machine, cause the machine to generate a background image, wherein the background image is automatically selected based on contextual information, and wherein the animation device is to use the background image when animating the avatar, wherein the contextual information is information corresponding to at least one of:
the avatar, a background to the series of images of the face, or a location of the user.

16. The at least one machine-readable medium of claim 12 , further comprising instructions, which when executed by a machine, cause the machine to:
determine a location at the image capture device; and
use the location at the image capture device to generate a location-based avatar; and
wherein the animation device is to use the facial motion data to animate the location-based avatar.

17. A system for animating an avatar, the system comprising:
a communication module coupled to a first device to receive facial motion data from a capture device, wherein the capture device is to capture a series of images of a face of a user and compute the facial motion data for each of the images in the series of images, wherein the capture device is configured to capture an image corresponding to content of a second device, the second device to be viewed by the user, wherein the second device and first device comprise a second-screen usage system, when in operation by the user, wherein the content of the second device is different than the series of images of the first user;
the first device to:
use an identity of the content associated with the image corresponding to the content, and
generate, using the identity of the content, a list of one or more content related avatars, the one or more content

Assignees

• Intel Corp

Inventors

• Li Wenlong
• Tong Xiaofeng
• Du Yangzhou
• Sachson Thomas

Classifications

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T2207/30201

  Face · CPC title

• G06V40/176

  Dynamic expression · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title