Selecting and correlating physical activity data with image data

Patent metadata

Field	Value
Publication number	US-9411940-B2
Application number	US-201213399452-A
Country	US
Kind code	B2
Filing date	Feb 17, 2012
Priority date	Feb 17, 2011
Publication date	Aug 9, 2016
Grant date	Aug 9, 2016

Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user's performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

First claim

We claim:

1. A computer-implemented method comprising:
providing an athletic performance monitoring application for operation with at least a first image capturing device;
receiving physical activity data relating to a performance of a physical activity by a first user comprising data generated by or derived from a force sensor;
determining that at least a portion of the physical activity data is indicative of the first user being within a performance zone based, at least in part, upon the physical activity data indicating that the first user meets a requirement for performing a first athletic action of an athletic activity irrespective of whether the first user performed the first athletic action,
wherein the determination activates the athletic performance monitoring application to cause at least the first image capturing device to initiate capture of image data relating to the performance of the physical activity by the first user;
correlating image data captured during the first user's performance with the physical activity data indicative of the first user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;
identifying at least a first portion of physical activity data to be overlaid with the correlated image data;
receiving input selections from a plurality of viewers identifying one or more physical activity parameters; and
for one or more viewers:
dynamically modifying the first portion of physical activity data to be overlaid with the correlated image data based at least in part on the received input selections; and
forming a single file comprising the correlated image data and the first portion of physical activity data.

2. The method of claim 1 , further comprising:
transmitting the single file for display on a display device.

3. The method of claim 2 , wherein the correlating of the image data and the physical activity data occurs, at least in part, on a mobile terminal and the display device is a screen operatively connected to the mobile terminal.

4. The method of claim 1 , further comprising:
displaying the correlated image data and at least the first portion of physical activity data on a first display device; and
displaying the correlated image data and at least a second portion of physical activity data on a second display device.

5. The method of claim 1 , further comprising:
receiving a first overlay input configured to display the first portion of the physical activity data with a corresponding segment of the correlated image data; and
receiving a second overlay input configured to display a second portion of the physical activity data with the corresponding segment of the correlated image data.

6. The method of claim 1 , wherein the received physical activity data includes data selected from the group consisting of: processed data, raw data, and combinations thereof.

7. The method of claim 1 , wherein the performance zone comprises a first performance zone including at least one criterion that differs from a second performance zone, the method further comprising:
identifying physical activity data to be overlaid with the correlated image data based, at least in part, on the determination that the first user was in the first performance zone during the capturing of at least a portion of the physical activity data.

8. The method of claim 7 , wherein the first performance zone includes at least one criterion selected from the group consisting of: a minimum height for a vertical leap, a minimum rate of acceleration, threshold force upon the force sensor, and combinations thereof.

9. The method of claim 1 , further comprising:
determining a most favorable value of a first physical activity parameter for at least one of the first user and a second user obtained during capturing of the image data; and
designating an image from the image data correlated with the physical activity data comprising the most favorable value as a representative image.

10. The method of claim 9 , wherein the first physical parameter is selected from the group consisting of: height for a vertical leap, rate of acceleration, force upon the force sensor, and combinations thereof.

11. The method of claim 1 , further comprising:
based on the physical activity data obtained during the capturing of the image data, identifying a segment of the image data correlated with at least one instance of the first user being in a performance zone; and
designating an image from the image data correlated with the at least one instance of the user being in the performance zone as a representative image.

12. The method of claim 11 , wherein the at least one instance comprises a plurality of instances and the method further comprises:
creating a highlight reel comprising the images associated with the user being in the performance zone.

13. The method of claim 1 , wherein the first user and a second user are participating in a sporting event, the method further comprising:
receiving physical activity data relating to a performance of a physical activity by the second user comprising data generated by or derived from a force sensor;
determining that at least a portion of the physical activity data is indicative of the second user being within a performance zone based, at least in part, upon the physical activity data indicating that the second user meets a requirement for performing a second athletic action of a second athletic activity irrespective of whether the second user performed the second athletic action,
wherein the determination that at least a portion of the physical activity data is indicative of the second user being within the performance zone activates the athletic performance monitoring application to cause at least a second image capturing device to initiate capture of image data relating to the performance of the physical activity by the second user;
correlating image data captured during the second user's performance with the physical activity data indicative of the second user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;
identifying at least a portion of the physical activity data to be overlaid with the correlated image data associated with the second user; and
forming a single file comprising the correlated image data and the portion of the physical activity data associated with the second user.

14. The method of claim 13 , wherein the single file comprising the image data of the first user is the same file as the single file comprising the image data of the second user.

15. The method of claim 13 , further comprising:
determining a most favorable value of a first physical activity parameter for at least one of the first user and the second user obtained during capturing of the image data; and
designating an image from the image data correlated with the physical activity data comprising the most favorable value as a representative image.

16. The method of claim 15 , wherein the first physical activity parameter is selected from the group consisting of: height for a vertical leap, rate of acceleration, force upon the force sensor, and combinations thereof.

17. The method of claim 13 , further comprising:
based on the physical data obtained during the capturing of the image data, identifying a segment of the image data correlated with at least one instance of the first user being in a performance zone; and
designating an image from the image data correlated with at least on

Assignees

• Burroughs Brandon S
• Engelberg Richard J
• Rice Jordan M
• Sweet Bob
• Weast Aaron B
• Convay Wade
• Rooke-Ley Joshua
• Nike Inc

Inventors

• Burroughs Brandon S
• Engelberg Richard J
• Rice Jordan M
• Sweet Bob
• Weast Aaron B
• Convay Wade
• Rooke-Ley Joshua

Classifications

• G09G5/14

  Display of multiple viewports · CPC title

• A63B2220/805

  Optical or opto-electronic sensors · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• G09B19/0038 Primary

  Sports · CPC title

• G09G2340/10

  Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels · CPC title