Dynamic remapping of components of a virtual skeleton

Patent metadata

Field	Value
Publication number	US-9824478-B2
Application number	US-201615371036-A
Country	US
Kind code	B2
Filing date	Dec 6, 2016
Priority date	Jun 27, 2014
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

Technologies are described herein for dynamically remapping components of a virtual skeleton to enhance the control and appearance of an avatar. Embodiments disclosed herein may remap components of the virtual skeleton if a need for an enhancement, replacement or correction is identified. For example, one or more components of a virtual skeleton, e.g., a joint, hand, arm or leg, may be remapped with modeled components if the component is distorted, missing or incomplete. Components of a virtual skeleton may be remapped with modeled components if enhancements, augmentations, corrections or special effects are desired. A remapped skeleton defining one or more modeled components may be generated from model data. The remapped skeleton may be used to drive user-controlled animations having enhanced movement and appearance characteristics. In addition to driving user-controlled animations, the remapped skeleton may be used to drive robotic devices.

First claim

What is claimed is:

1. A computer-implemented method for processing input data defining a virtual skeleton, the computer-implemented method comprising:
identifying, at a computing device, a component of the virtual skeleton to be remapped based on a conflict between the component and a virtual object, the identifying comprising one or more of:
identifying that the component of the virtual skeleton is missing from a frame of the input data, and
identifying a distortion of the component of the virtual skeleton in the frame of the input data;

obtaining, at the computing device, model data defining at least one modeled component;
remapping the component of the virtual skeleton using the model data to generate a remapped component; and
generating, at the computing device, a remapped virtual skeleton including the remapped component.

2. The computer-implemented method of claim 1 , further comprising applying the remapped virtual skeleton to a consuming resource configured to determine graphical animations based on the remapped skeleton.

3. The computer-implemented method of claim 1 , wherein identifying the component of the virtual skeleton to be remapped further comprises:
determining a first location of the component of the virtual skeleton;
determining a second location of the virtual object;
determining if the first location of the component of the virtual skeleton is in conflict with the second location of the virtual object; and
identifying the component of the virtual skeleton to be remapped responsive to determining that the first location of the component of the virtual skeleton is in conflict with the second location of the virtual object.

4. The computer-implemented method of claim 3 , wherein obtaining the model data comprises:
determining a third location for the component of the virtual skeleton, wherein the third location is not in conflict with the second location of the virtual object; and
generating the model data defining the at least one modeled component, wherein a fourth location of the at least one modeled component is based on the third location.

5. The computer-implemented method of claim 1 , wherein obtaining the model data comprises:
determining a parameter defining a size of the component of the virtual skeleton in a reference frame of the input data defining the virtual skeleton; and
configuring a size of the at least one modeled component based on the parameter defining the size of the component of the virtual skeleton.

6. The computer-implemented method of claim 1 ,
wherein obtaining the model data comprises accessing pre-recorded data defining a skeletal model, and
wherein the remapped component of the remapped virtual skeleton is further based on the pre-recorded data defining the skeletal model,
wherein the input data defining the virtual skeleton identifies a first position of the component of the virtual skeleton, and
wherein the remapped virtual skeleton is configured to enable the input data defining the virtual skeleton to control a second position of the remapped component using the first position of the component of the virtual skeleton.

7. One of a non-transitory solid state storage device, an optical disk or a magnetic storage device having computer-executable instructions stored thereupon which, when executed by a computing device, cause the computing device to:
obtain input data defining a virtual skeleton;
identify a component of the virtual skeleton to be remapped, the identifying comprising one or more of:
identifying that the component of the virtual skeleton is missing from a frame of the input data, and
identifying a distortion of the component of the virtual skeleton in the frame of the input data;

obtain model data defining a modeled component;
remap the component of the virtual skeleton using the model data to generate a remapped component; and
generate a remapped virtual skeleton including the remapped component.

8. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 7 , wherein the computer-executable instructions, when executed by the computing device, further cause the computing device to identify the component of the virtual skeleton to be remapped based on a conflict between the component to be remapped and a virtual object.

9. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 7 , wherein identifying the component of the virtual skeleton to be remapped comprises:
determining a first location of the component of the virtual skeleton;
determining a second location of a virtual object;
determining if the first location of the component of the virtual skeleton is in conflict with the second location of the virtual object; and
identifying the component of the virtual skeleton to be remapped responsive to determining that the first location of the component of the virtual skeleton is in conflict with the second location of the virtual object.

10. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 9 , wherein obtaining the model data further comprises:
determining a third location for the component of the virtual skeleton, wherein the third location is not in conflict with the second location of the virtual object; and
generating the model data defining the modeled component, wherein a fourth location of the modeled component is based on the third location.

11. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 7 , wherein the obtaining the model data comprises:
determining a parameter defining a size of the component of the virtual skeleton in a reference frame of the input data defining the virtual skeleton; and
configuring a size of the modeled component based on the parameter defining the size of the component of the virtual skeleton.

12. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 7 ,
wherein obtaining the model data comprises accessing pre-recorded data defining a skeletal model,
wherein the remapped component of the remapped virtual skeleton is further based on the pre-recorded data defining the skeletal model,
wherein the input data defining the virtual skeleton identifies a position of the component of the virtual skeleton, and
wherein the remapped virtual skeleton is configured to enable the input data defining the virtual skeleton to control a position of the remapped component of the remapped virtual skeleton using the position of the component of the virtual skeleton.

13. The non-transitory solid state storage device, optical disk or magnetic storage device of claim 7 , wherein obtaining the model data comprises accessing customized skeletal data that defines one or more skeletal components with fictional physical and movement properties, and wherein the remapped component of the remapped virtual skeleton is further based on the customized skeletal data.

14. A computing device, comprising:
a processor; and
a memory having computer-executable instructions stored thereupon which, when executed by the processor, cause the computing device to:
obtain input data defining a virtual skeleton, wherein the virtual skeleton comprises a plurality of connections and a plurality of joints, wherein individual joints of the plurality of joints are configured between individual connections of the plurality of connections;
identify a need to enhance or replace a virtual joint of the plurality of joints and a virtual connection of the plurality of connections, the identifying comprising one or more of:
ident

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Marlow Christopher Richard
• Umlauf Eike Jens
• Preston Andrew John

Classifications

• G06V40/103 Primary

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06V10/34

  Smoothing or thinning of the pattern; Morphological operations; Skeletonisation · CPC title

• G06K9/00369

  Physics · mapped topic

• G06T2207/30196

  Human being; Person · CPC title