Mechanism for facilitating dynamic simulation of avatars corresponding to changing user performances as detected at computing devices

Patent metadata

Field	Value
Publication number	US-9489760-B2
Application number	US-201314358394-A
Country	US
Kind code	B2
Filing date	Nov 14, 2013
Priority date	Nov 14, 2013
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

A mechanism is described for facilitating dynamic simulation of avatars based on user performances according to one embodiment. A method of embodiments, as described herein, includes capturing, in real-time, an image of a user, the image including a video image over a plurality of video frames. The method may further include tracking changes in size of the user image, the tracking of the changes may include locating one or more positions of the user image within each of the plurality of video frames, computing, in real-time, user performances based on the changes in the size of the user image over the plurality of video frames, and dynamically scaling an avatar associated with the user such that the avatar is dynamically simulated corresponding to the user performances.

First claim

What is claimed is:

1. An apparatus comprising:
reception and capturing logic to capture, in real-time, a live image of a user, wherein the live image includes a live video image over a plurality of video frames, wherein the live image is being communicated, in real-time, for facilitating live viewing of a live avatar corresponding to the live image using one or more display screens of the apparatus or one of more computing devices;
detection/tracking logic to track changes in size of the live image, wherein tracking the changes includes locating one or more positions of the live image within each of the plurality of video frames;
computation engine to compute, in real-time, user performances based on the changes in the size of the live image over the plurality of video frames, wherein the use performances are further computed based on the user's gestures including facial expressions as interpreted from tracking of a plurality of facial point on the user's face; and
scaling logic to dynamically scale the live avatar associated with the user and corresponding to the live image such that the live avatar is dynamically simulated corresponding to the user performances.

2. The apparatus of claim 1 , wherein the reception and capturing logic is further to facilitate an image source to receive and capture the live image, wherein the image source includes a camera or a scanner.

3. The apparatus of claim 1 , wherein locating the one or more positions comprises measuring one or more distances between the user and the image source of the apparatus, wherein the one or more distances represent zooming-in or zooming-out of the user with respect to the image source.

4. The apparatus of claim 1 , wherein the computation engine comprises reference value calculation logic to calculate, in real time and based on pre-determined criteria, a reference value representing a default value.

5. The apparatus of claim 4 , wherein the computation engine further comprises image size calculation logic to calculate, in real-time, an image size value based on the changes in the size of the live image.

6. The apparatus of claim 5 , wherein the computation engine further comprises avatar scale factor calculation logic to calculate, in real-time, an avatar factor based on the image size value by the reference value, wherein the image size value is divided by the reference value.

7. The apparatus of claim 1 , wherein the user performances are dynamically computed based on the avatar scale factor, wherein the user performances comprise zooming-in of the user or zooming-out of the user with respect to the image source of the apparatus, the user performances further comprising one or more human expressions including one or more of laugh, anger, surprise, sad, fear, disgust, smile, frown, cry, happy, speak, silent, eat, drink, sing, yawn, and sneeze.

8. The apparatus of claim 1 , further comprising a display device to display the scaled live avatar that is simulated according to the user performances.

9. The apparatus of claim 1 , further comprising extraction and deformation logic to extract a plurality of points on the live image by facilitating, via mashing and mapping module, a three-dimensional mesh of the live image.

10. The apparatus of claim 9 , wherein the extraction and deformation logic is further to deform the live avatar based on the user's gestures as determined from the plurality of points on the live image, wherein the live image includes an image of the user's face, and the plurality of points include the plurality of facial points on the user's face.

11. A method comprising:
capturing, in real-time, a live image of a user, wherein the live image includes a live video image over a plurality of video frames, wherein the live image is being communicated, in real time, for facilitating live viewing of a live avatar corresponding to the live image using one of more display screens of a computing device or one of more other computing devices;
tracking changes in size of the live image, wherein tracking the changes includes locating one or more positions of the live image within each of the plurality of video frames;
computing, in real-time, user performances based on the changes in the size of the live image over the plurality of video frames, wherein the user performances are further computer based on the user's gestures including facial expressions as interpreted from tracking of plurality of facial points on the user's face; and
dynamically scaling the live avatar associated with the user and corresponding to the live image such that the live avatar is dynamically simulated corresponding to the user performances.

12. The method of claim 11 , wherein capturing further comprises facilitating an image source to receive and capture the live image; wherein the image source includes a camera or a scanner.

13. The method of claim 11 , wherein locating the one or more positions comprises measuring one or more distances between the user and the image source of the computing device, wherein the one or more distances represent zooming-in or zooming-out of the user with respect to the image source.

14. The method of claim 11 , wherein computing further comprises calculating, in real-time and based on pre-determined criteria, a reference value representing a default value.

15. The method of claim 14 , wherein computing further comprises calculating, in real-time, an image size value based on the changes in the size of the live image.

16. The method of claim 15 , wherein computing further comprises calculating, in real-time, an avatar factor based on the image size value by the reference value, wherein the image size value is divided by the reference value.

17. The method of claim 11 , wherein the user performances are dynamically computed based on the avatar scale factor, wherein the user performances comprise zooming-in of the user or zooming-out of the user with respect to the image source of the computing device, the user performances further comprising one or more human expressions including one or more of laugh, anger, surprise, sad, fear, disgust, smile, frown, cry, happy, speak, silent, eat, drink, sing, yawn, and sneeze.

18. The method of claim 11 , further comprising displaying, via a display device, the scaled live avatar that is simulated according to the user performances.

19. The method of claim 11 , further comprising extracting a plurality of points on the live image by facilitating a three-dimensional mesh of the live image.

20. The method of claim 19 , further comprising deforming the live avatar based on the user's gestures as determined from the plurality of points on the live image, wherein the live image includes an image of the user's face, and the plurality of points include a plurality of facial points on the user's face.

21. At least one non-transitory machine-readable medium comprising a plurality of instructions that in response to being executed on a computing device, causes the computing device to:
capture, in real-time, a live image of a user, wherein the live image includes a live video image over a plurality of video frames, wherein the live image is being communicated, in real time, for facilitating live viewing of a live avatar corresponding to the live image using one or more display screens of the computing device or one of more other computing devices;
track changes in size of the live image, wherein tracking the changes includes locating one or more positions of the live image within each of the plurality

Assignees

• Intel Corp

Inventors

• Li Wenlong
• Tong Xiaofeng
• Du Yangzhou
• Sachson Thomas

Classifications

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G06K9/00342

  Physics · mapped topic

• G06T7/0022

  Physics · mapped topic