Image based ground weight distribution determination

Patent metadata

Field	Value
Publication number	US-2016110593-A1
Application number	US-201414517042-A
Country	US
Kind code	A1
Filing date	Oct 17, 2014
Priority date	Oct 17, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

A sequence of images is processed to interpret movements of a user. The user's contour and center of gravity are determined and tracked. Based on points of contact between the user and the environment, and upon tracked movement of the center of gravity, forces impressed by the user upon the points of contact with the environment may be deduced by constraint analysis. This center-of-mass model of user movements may be used in conjunction with a skeletal model of the user to provide verification of the validity of the skeletal model. The center-of-mass model may also be used alternatively with the skeletal model fails during those times when use of the skeletal model is problematic.

First claim

We claim:

1 . A system comprising:
a processor; and memory coupled to the processor, the memory comprising executable instructions that, when executed by the processor cause, the processor to effectuate operations comprising:
determining a first contour of a targeted user from a first image;
determining a first center of mass of the targeted user from the first contour;
determining a first point of contact, at which the targeted user is in contact with a first fixture; and
determining a first force by a constraint analysis comprising a geometrical relationship of the first center of mass to the first point of contact.

2 . The system of claim 1 , the operations further comprising:
determining a second contour of the targeted user from a second image; determining a second center of mass of the targeted user from the second contour; determining a movement from the first center of mass to the second center of mass; determining an acceleration from the movement and the time difference between the first image and the second image; and determining the first force, where the constraint analysis further comprises the acceleration.

3 . The system of claim 2 , the operations further comprising:
during a first period, modeling an avatar by mapping plural identifiable portions of the first contour to skeletal segments of the avatar; and during a second period, modeling the avatar by inferring the movement of the skeletal segments of the avatar in accordance with the movement.

4 . The system of claim 2 the operations further comprising:
determining a second point of contact, at which the targeted user is in contact with a second fixture; and
determining the first force and a second force, where the constraint analysis further comprises a geometrical relationship of the first center of mass to the second point of contact.

5 . The system of claim 1 , the first fixture comprising at least one of a floor, a wall, a doorway, a bar, a handle, a box, a platform, a bench, or a chair.

6 . The system of claim 1 , wherein:
the first image comprises a two-dimensional image from a camera; and the first contour comprises a two dimensional outline.

7 . The system of claim 1 , the first image comprising a depth image and the first contour comprising a three dimensional depth hull.

8 . A method comprising:
determining a first contour of a targeted user from a first image; determining a first center of mass of the targeted user from the first contour; determining a first point of contact, at which the targeted user is in contact with a first fixture; and determining a first force by a constraint analysis comprising a geometrical relationship of the first center of mass to the first point of contact.

9 . The method of claim 8 , further comprising:
determining a second contour of the targeted user from a second image; determining a second center of mass of the targeted user from the second contour; determining a movement from the first center of mass to the second center of mass; determining an acceleration from the movement and the time difference between the first image and the second image; and determining the first force, where the constraint analysis further comprises the acceleration.

10 . The method of claim 9 , further comprising:
during a first period, modeling an avatar by mapping plural identifiable portions of the first contour to skeletal segments of the avatar; and during a second period, modeling the avatar by inferring the movement of the skeletal segments of the avatar in accordance with the movement.

11 . The method of claim 9 , further comprising:
determining a second point of contact, at which the targeted user is in contact with a second fixture; and determining the first force and a second force, where the constraint analysis further comprises a geometrical relationship of the first center of mass to the second point of contact.

12 . The method of claim 8 , wherein the first fixture comprises at least one of a floor, a wall, a doorway, a bar, a handle, a box, a platform, a bench, or a chair.

13 . The method of claim 8 , wherein:
the first image comprises a two-dimensional image from a camera; and the first contour comprises a two dimensional outline.

14 . The method of claim 8 wherein:
the first image comprises a depth image; and
the first contour comprises a three dimensional depth hull.

15 . A computer-readable storage medium comprising executable instructions that, when executed by a processor, cause the processor to effectuate operations comprising:
determining a first contour of a targeted user from a first image; determining a first center of mass of the targeted user from the first contour; determining a first point of contact, at which the targeted user is in contact with a first fixture; and determining a first force by a constraint analysis comprising a geometrical relationship of the first center of mass to the first point of contact.

16 . The computer-readable storage medium of claim 15 , the operations further comprising:
determining a second contour of the targeted user from a second image; determining a second center of mass of the targeted user from the second contour; determining a movement from the first center of mass to the second center of mass; determining an acceleration from the movement and the time difference between the first image and the second image; and determining the first force, where the constraint analysis further comprises the acceleration.

17 . The computer-readable storage medium of claim 16 , the operations further comprising:
during a first period, modeling an avatar by mapping plural identifiable portions of the first contour to skeletal segments of the avatar; and during a second period, modeling the avatar by inferring the movement of the skeletal segments of the avatar in accordance with the movement.

18 . The computer-readable storage medium of claim 16 , the operations further comprising:
determining a second point of contact, at which the targeted user is in contact with a second fixture; and determining the first force and a second force, where the constraint analysis further comprises a geometrical relationship of the first center of mass to the second point of contact.

19 . The computer-readable storage medium of claim 15 , wherein:
the first image comprises a two-dimensional image from a camera; and the first contour comprises a two dimensional outline.

20 . The computer-readable storage medium of claim 15 , wherein:
the first image comprises a depth image; and the first contour comprises a three dimensional depth hull.

Assignees

• Microsoft Corp

Inventors

• Hoof Jonathan
• Kennett Daniel

Classifications

• A63F13/428 Primary

  involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes · CPC title

• G06V40/23

  Recognition of whole body movements, e.g. for sport training · CPC title

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title

• G06T7/602

  Physics · mapped topic

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title