Selecting and correlating physical activity data with image data

Patent metadata

Field	Value
Publication number	US-10179263-B2
Application number	US-201615197014-A
Country	US
Kind code	B2
Filing date	Jun 29, 2016
Priority date	Feb 17, 2011
Publication date	Jan 15, 2019
Grant date	Jan 15, 2019

Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user's performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

First claim

We claim:

1. A computer-implemented method comprising:
receiving a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a user, wherein the first set of physical activity data is generated by or derived from a first sensor, and wherein the first set of physical activity data further comprises at least one of: a shoe type, a shoe color, or a shoe size associated with the user during the athletic performance;
capturing, by an image capturing device, image data corresponding to at least the first activity performed by the user;
determining, by one or more processors, whether a portion of the first set of physical activity data indicates that the user has satisfied a first activity threshold;
correlating, in response to determining that the portion of the first set of physical activity data indicates that the user has satisfied the first activity threshold, the image data in accordance with the portion of the first set of physical activity data;
dynamically modifying, based on user input selections, the portion of the first set of physical activity data to be overlaid with the correlated image data;
joining the correlated image data and the portion of the first set of physical activity data into a single file; and
transmitting the file to a computing device for display to the user.

2. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, and wherein the correlating the image data further comprises:
associating a first number of frames of the image data with a corresponding time period of the first set of physical activity data.

3. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of frames, the computer-implemented method further comprising:
determining, by the one or more processors, a plurality of activity values for a first activity metric corresponding to the portion of the first set of physical activity data; and
adjusting the plurality of activity values to be associated with at least a first frame of the image data.

4. The computer-implemented method of claim 1 , further comprising:
establishing a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and
in response to establishing the communication channel, outputting, to a display device, a communication prompting the user to perform the first activity.

5. The computer-implemented method of claim 1 , further comprising:
generating, by the one or more processors, a summary video segment associated with the image data; and
outputting, to a display device, an overlay for the summary video segment, wherein the overlay comprises origination data for the first set of physical activity data.

6. The computer-implemented method of claim 1 , further comprising:
receiving an input selection identifying the user; and
in response to receiving the input selection, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

7. The computer-implemented method of claim 1 , further comprising:
determining, based on the portion of the first set of physical activity data, a second activity performed by the user during the athletic performance; and
in response to the determining the second activity, initiating the correlation of the image data in accordance with the portion of the first set of physical activity data.

8. The computer-implemented method of claim 1 , further comprising:
receiving a second set of physical activity data corresponding to one or more previous athletic performances where the user performed the first activity; and
correlating the image data in accordance with the second set of physical activity data.

9. The computer-implemented method of claim 1 , further comprising:
determining, based on a second portion of the first set of physical activity data, that the user has satisfied a performance zone threshold; and
in response to the determining the performance zone threshold is satisfied, initiating the capturing of the image data in accordance with the second portion of the first set of physical activity data.

10. One or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause the at least one processor to:
receive a first set of physical activity data corresponding to an athletic performance comprising at least a first activity performed by a user, wherein the first set of physical activity data is generated by or derived from a first sensor, and wherein the first set of physical activity data further comprises at least one of: a shoe type, a shoe color, or a shoe size associated with the user during the athletic performance;
determine that one or more portions of the first set of physical activity data indicate that the user has satisfied a first activity threshold;
in response to the determining that the one or more portions of the first set of physical activity data indicates that the user has satisfied the first activity threshold, capture, by an image capturing device, image data corresponding to at least the first activity performed by the user;
determine, based on the one or more portions of the first set of physical activity data, a second activity performed by the user during the athletic performance;
in response to the determining that the user performed the second activity, initiate the correlation of the image data in accordance with the one or more portions of the first set of physical activity data;
dynamically modify, based on user input selections, the one or more portions of the first set of physical activity data to be overlaid with the correlated image data;
join the correlated image data and the one or more portions of the first set of physical activity data into a single file; and
transmit the file to a computing device for display to the user.

11. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to:
receive a second set of physical activity data corresponding to one or more previous athletic performances where the user performed the first activity; and
correlate the image data in accordance with the second set of physical activity data.

12. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to:
establish a communication channel with the first sensor, wherein the first sensor comprises a force sensor; and
in response to establishing the communication channel, output, to a display device, a communication prompting the user to perform the first activity.

13. The one or more non-transitory computer readable media of claim 12 , wherein the instructions, when executed, further cause the at least one processor to:
generate a summary video segment associated with the image data; and
output, to a display device, an overlay for the summary video segment, wherein the overlay comprises origination data for the first set of physical activity data.

14. The one or more non-transitory computer readable media of claim 10 , wherein the instructions, when executed, further cause the at least one processor to correlate the image data in accordance with the portion of the first set of physical activity data by:
determining that the portion of the physical activity data indicates the user performed a first type of athletic activity; and
in response to determining that the user performed the first type of athle

Assignees

• Nike Inc

Inventors

• Burroughs Brandon S
• Engelberg Richard J
• Rice Jordan M
• Sweet Bob
• Weast Aaron B
• Convay Wade
• Rooke-Ley Joshua

Classifications

• A63B43/00

  Balls with special arrangements · CPC title

• A63B43/06

  with illuminating devices {; with reflective surfaces} · CPC title

• A63B2220/40

  Acceleration · CPC title

• A63B2220/72

  Temperature · CPC title

• A63B2230/06

  heartbeat rate only · CPC title