System to identify and use markers for motion capture

Patent metadata

Field	Value
Publication number	US-10147218-B2
Application number	US-201615280883-A
Country	US
Kind code	B2
Filing date	Sep 29, 2016
Priority date	Sep 29, 2016
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

Methods and systems that enhance motion capture capabilities. In one such method, the motion capture system enables a user to set parameters, based on hue, lightness, and saturation, for example, to assist in identifying and searching for motion capture markers that are applied to real-life subjects. In another implementation, the motion capture system enables a user to determine a distance between a master marker and a slave marker, and to use that distance to establish bounding boxes for searching for the slave marker in subsequent frames. Further, in some implementations, the motion capture system further uses the distance when rendering an animated scene based on the motion capture session to estimate the position of the slave marker when the slave marker is not visible in a captured frame.

First claim

The invention claimed is:

1. A method for identifying a marker used in a motion capture session, the method comprising:
identifying in a first frame of the motion capture session a master marker;
identifying in the first frame a slave marker, the slave marker separated from the master marker by a distance;
using the distance to create a bounding box in subsequent frames of the motion capture session; and
searching within the bounding box for the slave marker in the subsequent frames of the motion capture session.

2. The method of claim 1 , wherein the distance between the master marker and the slave marker is determined by calculating the number of pixels separating the master marker and the slave marker.

3. The method of claim 1 , further comprising:
obtaining coordinates corresponding to a location of a target pixel within the slave marker as rendered in the first frame;
selecting a set of pixels, the set of pixels including the target pixel and pixels surrounding the target pixel;
analyzing the target pixel and the surrounding pixels in the set of pixels to determine display characteristics of the pixels; and
using the display characteristics of the pixels to identify the slave marker in additional frames captured during the motion capture session.

4. A method of rendering an animated subject based upon movements of a real-life subject wearing one or more physical markers during a motion capture session, the method comprising:
identifying a physical master marker;
identifying a physical slave marker, the physical slave marker separated from the physical master marker by a distance;
calculating the distance between the physical master marker and the physical slave marker;
associating a virtual slave marker with the physical slave marker, the virtual slave marker being separated from the physical master marker by the distance; and
rendering the animated subject, to maintain the distance between the physical master marker and the virtual slave marker; and
using positional information about the virtual slave marker to render the animated subject when positional information from the physical slave marker is not available.

5. The method of claim 4 , wherein the positional information calculated for the virtual slave marker differs from the positional information for the physical slave marker during at least a portion of the rendering of the animated subject.

6. A system to identify a marker used in a motion capture session, the system comprising:
a memory device in communication with a processor, the memory device having instructions stored thereon that, in response to execution by the processor, cause the processor to:
identify in a first frame of the motion capture session a master marker;
identify in the first frame a slave marker, the slave marker separated from the master marker by a distance;
use the distance to create a bounding box in subsequent frames of the motion capture session; and
search within the bounding box for the slave marker in the subsequent frames of the motion capture session.

7. The system of claim 6 , wherein the distance between the master marker and the slave marker is determined by calculating the number of pixels separating the master marker and the slave marker.

8. The system of claim 7 , wherein the instructions stored on the memory device, in response to execution by the processor, further cause the processor to:
obtain coordinates corresponding to a location of a target pixel within the slave marker as rendered in the first frame;
select a set of pixels, the set of pixels including the target pixel and pixels surrounding the target pixel;
analyze the target pixel and the surrounding pixels in the set of pixels to determine display characteristics of the pixels; and
use the display characteristics of the pixels to identify the slave marker in additional frames captured during the motion capture session.

9. A system to render an animated subject based upon movements of a real-life subject wearing one or more physical markers during a motion capture session, the system comprising:
a memory device in communication with a processor, the memory device having instructions stored thereon that, in response to execution by the processor, cause the processor to:
identify a physical master marker;
identify a physical slave marker, the physical slave marker separated from the physical master marker by a distance;
calculate the distance between the physical master marker and the physical slave marker;
associate a virtual slave marker with the physical slave marker, the virtual slave marker being separated from the master marker by the distance; and
rendering the animated subject to maintain the distance between the master marker and the virtual slave marker; and
use positional information about the virtual slave marker to render the animated subject when positional information from the physical slave marker is not available.

10. The system of claim 9 , wherein the positional information calculated for the virtual slave marker differs from the positional information for the physical slave marker during at least a portion of the rendering of the animated subject.

Assignees

• Sony Interactive Entertainment America Llc

Inventors

• Alkouh Homoud B

Classifications

• G06T7/0042

  Physics · mapped topic

• G06T2210/12

  Bounding box · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T13/40 Primary

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T2207/30204

  Marker · CPC title