Probabilistic and constraint based articulated model fitting

Patent metadata

Field	Value
Publication number	US-9344707-B2
Application number	US-201213688064-A
Country	US
Kind code	B2
Filing date	Nov 28, 2012
Priority date	Jun 29, 2011
Publication date	May 17, 2016
Grant date	May 17, 2016

Abstract

A depth sensor obtains images of articulated portions of a user's body such as the hand. A predefined model of the articulated body portions is provided. Representative attract points of the model are matched to centroids of the depth sensor data, and a rigid transform of the model is performed, in an initial, relatively coarse matching process. This matching process is then refined in a non-rigid transform of the model, using attract point-to-centroid matching. In a further refinement, an iterative process rasterizes the model to provide depth pixels of the model, and compares the depth pixels of the model to the depth pixels of the depth sensor. The refinement is guided by whether the depth pixels of the model are overlapping or non-overlapping with the depth pixels of the depth sensor. Collision, distance and angle constraints are also imposed on the model.

First claim

We claim:

1. A computer readable storage device having computer readable software embodied thereon for programming at least one processor to perform a method for modeling a pose of articulated body portions of an object, the method comprising:
obtaining depth pixels of the articulated body portions of the object in one or more frames;
processing the depth pixels of the one or more frames to identify centroids of each of the articulated body portions of the object;
accessing a…

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Lee Kyungsuk David
• Balan Alexandru

Classifications

• G06F3/017

  Physics · mapped topic

• H04N13/271

  Electricity · mapped topic

• G06T2219/2016

  Physics · mapped topic

• G06T17/00 Primary

  Physics · mapped topic

• G06T19/20

  Physics · mapped topic